Jul 28 01:23:47.005650 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 01:23:47.005658 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 01:23:47.005665 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 01:23:47.005896 ip-10-0-138-146 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 01:23:57.079458 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 01:23:57.079491 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fc36976dccfb4e71a69269866bc93687 -- Jul 28 01:25:28.117248 ip-10-0-138-146 systemd[1]: Starting Kubernetes Kubelet... Jul 28 01:25:28.563331 ip-10-0-138-146 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 01:25:28.563331 ip-10-0-138-146 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 01:25:28.563331 ip-10-0-138-146 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 01:25:28.563331 ip-10-0-138-146 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 01:25:28.563331 ip-10-0-138-146 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 01:25:28.564029 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.563449 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 01:25:28.572327 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572307 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.572327 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572322 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.572327 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572327 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.572327 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572330 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.572327 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572335 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572338 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572341 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572343 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572346 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572349 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572351 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572354 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572357 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572359 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572362 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572365 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572367 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572370 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572372 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572375 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572378 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572380 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572383 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572385 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.572523 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572388 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572391 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572393 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572396 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572398 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572401 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572404 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572407 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572409 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572412 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572415 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572417 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572420 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572422 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572425 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572429 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572431 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572434 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572436 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572439 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.573045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572441 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572444 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572447 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572450 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572453 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572455 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572458 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572461 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572464 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572466 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572469 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572471 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572475 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572480 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572483 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572485 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572488 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572490 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572493 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572496 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.573532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572499 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572502 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572504 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572507 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572509 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572512 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572516 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572521 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572524 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572527 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572530 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572533 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572536 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572539 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572543 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572546 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572548 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572551 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572554 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.574062 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572565 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572568 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572571 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572573 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572576 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572578 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572581 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572584 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572587 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572590 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572593 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572596 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572599 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572601 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572604 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.572607 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573325 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573333 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573336 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573339 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.574548 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573342 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573345 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573347 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573350 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573353 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573355 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573358 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573361 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573363 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573366 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573369 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573373 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573376 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573379 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573381 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573384 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573386 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573389 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573391 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.575054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573394 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573396 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573399 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573402 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573404 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573407 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573409 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573411 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573414 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573416 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573419 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573421 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573425 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573428 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573431 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573433 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573436 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573439 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573441 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573444 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.575519 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573446 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573449 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573451 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573454 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573456 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573459 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573461 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573465 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573467 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573469 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573472 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573474 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573477 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573479 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573481 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573484 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573486 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573489 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573491 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573493 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.576018 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573496 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573500 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573503 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573505 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573508 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573510 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573513 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573516 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573518 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573521 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573523 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573526 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573528 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573531 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573533 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573536 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573539 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573541 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573544 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.576530 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573547 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573550 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573553 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573556 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573559 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573561 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573564 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573567 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573569 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573572 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573575 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573578 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573582 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573585 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573589 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573593 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573595 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573978 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573984 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.577011 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573987 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573991 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573994 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.573997 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574000 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574002 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574005 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574008 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574010 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574013 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574015 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574018 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574020 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574023 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574031 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574034 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574037 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574039 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574042 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574047 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.577471 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574050 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574052 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574055 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574057 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574060 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574062 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574067 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574070 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574073 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574075 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574078 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574080 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574083 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574085 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574088 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574090 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574093 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574095 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574098 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574101 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.578057 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574103 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574106 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574108 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574111 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574114 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574116 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574118 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574122 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574124 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574127 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574129 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574133 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574136 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574138 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574142 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574146 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574149 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574153 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574156 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574160 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.578563 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574162 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574165 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574167 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574169 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574172 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574174 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574177 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574179 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574182 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574184 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574186 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574189 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574191 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574194 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574196 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574198 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574201 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574203 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574206 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574209 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.579066 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574211 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574214 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574216 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574221 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574225 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574229 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574231 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574234 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574237 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574239 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574242 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574244 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574247 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574250 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574253 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574257 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574260 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574330 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574338 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574343 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 01:25:28.579533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574347 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574351 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574354 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574358 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574362 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574366 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574369 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574372 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574375 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574378 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574381 2582 flags.go:64] FLAG: --cgroup-root="" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574384 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574387 2582 flags.go:64] FLAG: --client-ca-file="" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574390 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574393 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574399 2582 flags.go:64] FLAG: --cluster-domain="" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574402 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574405 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574408 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574411 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574415 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574418 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574421 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 01:25:28.580040 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574424 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574427 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574430 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574433 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574436 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574439 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574443 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574446 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574449 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574452 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574455 2582 flags.go:64] FLAG: --enable-server="true" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574458 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574462 2582 flags.go:64] FLAG: --event-burst="100" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574464 2582 flags.go:64] FLAG: --event-qps="50" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574467 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574470 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574473 2582 flags.go:64] FLAG: --eviction-hard="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574477 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574480 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574483 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574486 2582 flags.go:64] FLAG: --eviction-soft="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574488 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574491 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574495 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574498 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 01:25:28.580606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574501 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574504 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574507 2582 flags.go:64] FLAG: --feature-gates="" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574511 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574514 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574517 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574520 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574522 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574525 2582 flags.go:64] FLAG: --help="false" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574528 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574531 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574534 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574537 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574540 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574543 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574546 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574549 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574552 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574554 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574557 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574561 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574563 2582 flags.go:64] FLAG: --kube-reserved="" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574566 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574569 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 01:25:28.581276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574572 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574574 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574577 2582 flags.go:64] FLAG: --lock-file="" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574580 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574582 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574585 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574590 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574595 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574598 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574601 2582 flags.go:64] FLAG: --logging-format="text" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574604 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574607 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574610 2582 flags.go:64] FLAG: --manifest-url="" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574612 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574617 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574620 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574624 2582 flags.go:64] FLAG: --max-pods="110" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574627 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574630 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574633 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574636 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574638 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574642 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574644 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574651 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 01:25:28.581864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574654 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574657 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574660 2582 flags.go:64] FLAG: --pod-cidr="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574663 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574668 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574670 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574673 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574676 2582 flags.go:64] FLAG: --port="10250" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574679 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574682 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2c0d5f4ca6f97b5" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574685 2582 flags.go:64] FLAG: --qos-reserved="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574688 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574691 2582 flags.go:64] FLAG: --register-node="true" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574694 2582 flags.go:64] FLAG: --register-with-taints="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574699 2582 flags.go:64] FLAG: --registry-burst="10" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574702 2582 flags.go:64] FLAG: --registry-qps="5" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574705 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574707 2582 flags.go:64] FLAG: --reserved-memory="" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574711 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574714 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574717 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574719 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574723 2582 flags.go:64] FLAG: --runonce="false" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574726 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574729 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 01:25:28.582490 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574732 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574735 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574738 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574741 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574744 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574747 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574749 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574752 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574755 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574758 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574761 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574763 2582 flags.go:64] FLAG: --system-cgroups="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574766 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574771 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574774 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574776 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574781 2582 flags.go:64] FLAG: --tls-min-version="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574783 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574786 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574789 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574791 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574796 2582 flags.go:64] FLAG: --v="2" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574799 2582 flags.go:64] FLAG: --version="false" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574804 2582 flags.go:64] FLAG: --vmodule="" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574807 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 01:25:28.583110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.574810 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574915 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574919 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574922 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574926 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574929 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574932 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574935 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574937 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574940 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574943 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574945 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574948 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574963 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574966 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574969 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574972 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574974 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574977 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.583715 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574980 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574982 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574985 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574988 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574990 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574993 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574996 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.574998 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575001 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575005 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575008 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575010 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575013 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575018 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575021 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575024 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575027 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575032 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575034 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.584188 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575038 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575041 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575043 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575046 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575049 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575052 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575054 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575057 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575060 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575062 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575065 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575068 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575071 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575073 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575076 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575078 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575081 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575083 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575086 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575090 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.584641 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575093 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575096 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575099 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575102 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575105 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575107 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575110 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575113 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575115 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575118 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575122 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575125 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575127 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575130 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575132 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575135 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575138 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575140 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575143 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575146 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.585146 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575148 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575151 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575153 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575156 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575158 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575161 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575164 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575168 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575171 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575174 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575177 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575179 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575181 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575184 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575187 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575189 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575192 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575194 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575197 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575199 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.585664 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575202 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.575204 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.575211 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582125 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582139 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582155 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582160 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582235 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582251 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582255 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582259 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582262 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582265 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582268 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582270 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.586174 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582273 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582277 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582281 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582284 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582288 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582290 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582294 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582298 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582301 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582304 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582307 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582309 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582312 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582314 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582317 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582320 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582323 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582325 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582328 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.586535 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582331 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582333 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582337 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582340 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582342 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582345 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582347 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582350 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582353 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582355 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582358 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582361 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582363 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582365 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582368 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582370 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582373 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582375 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582378 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582381 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.587054 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582383 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582386 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582388 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582391 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582393 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582395 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582398 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582400 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582403 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582405 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582413 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582416 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582419 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582421 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582426 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582429 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582432 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582435 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582437 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582440 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.587543 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582443 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582445 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582448 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582451 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582453 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582456 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582459 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582462 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582464 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582467 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582470 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582472 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582475 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582478 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582480 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582483 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582485 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582488 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582491 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582493 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.588045 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582496 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582499 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582501 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582510 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582512 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582515 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582518 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582520 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582523 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582526 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582528 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582531 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582536 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582644 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582647 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 01:25:28.588532 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582650 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582654 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582658 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582661 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582663 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582666 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582668 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582671 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582673 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582676 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582678 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582680 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582683 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582686 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582688 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582690 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582693 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582696 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582699 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 01:25:28.588896 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582701 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582704 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582707 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582709 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582712 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582714 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582717 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582720 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582724 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582726 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582729 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582732 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582735 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582738 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582740 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582743 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582745 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582748 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582750 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582752 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 01:25:28.589383 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582755 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582758 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582760 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582763 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582765 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582768 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582770 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582773 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582775 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582778 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582780 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582783 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582786 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582788 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582791 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582796 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582810 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582813 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582816 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582818 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 01:25:28.589865 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582821 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582823 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582826 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582828 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582832 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582836 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582839 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582841 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582844 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582847 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582849 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582852 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582854 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582869 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582873 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582875 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582878 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582881 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582884 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 01:25:28.590363 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582887 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582890 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582892 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582895 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582897 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582900 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582904 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582907 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582909 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582912 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582915 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582917 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582920 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582923 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582925 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582928 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582930 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582933 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 01:25:28.590818 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:28.582936 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.582940 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.583036 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.585256 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.586769 2582 server.go:1019] "Starting client certificate rotation" Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.586866 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.586894 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 01:25:28.591290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.590788 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 01:25:28.591855 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.591840 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 01:25:28.600542 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.600526 2582 log.go:25] "Validated CRI v1 runtime API" Jul 28 01:25:28.602912 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.602895 2582 log.go:25] "Validated CRI v1 image API" Jul 28 01:25:28.605832 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.605816 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 01:25:28.608354 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.608337 2582 fs.go:135] Filesystem UUIDs: map[4209b423-8b7f-41d9-b2f0-1c93e81d4dec:/dev/nvme0n1p3 505dde1d-dc2d-424d-8682-a91a7a9b6067:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 28 01:25:28.608434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.608353 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 01:25:28.614413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.614312 2582 manager.go:216] Machine: {Timestamp:2026-07-28 01:25:28.612888465 +0000 UTC m=+0.368718970 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099629 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b8b56ff462358b1c4f082b0ff8a73 SystemUUID:ec2b8b56-ff46-2358-b1c4-f082b0ff8a73 BootID:fc36976d-ccfb-4e71-a692-69866bc93687 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:67:0e:f7:b0:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:67:0e:f7:b0:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:ef:fe:f4:cc:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 01:25:28.614413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.614412 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 01:25:28.614512 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.614477 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 01:25:28.617872 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.617852 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 01:25:28.618123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.618103 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 01:25:28.618259 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.618127 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 01:25:28.618926 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.618916 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 01:25:28.618969 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.618929 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 01:25:28.618969 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.618936 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 01:25:28.619818 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.619807 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 01:25:28.620978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.620968 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 01:25:28.623090 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623079 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 01:25:28.623211 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623202 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 01:25:28.623250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623231 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 28 01:25:28.623250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623240 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 01:25:28.623250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623250 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 01:25:28.623356 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623259 2582 kubelet.go:398] "Adding apiserver pod source" Jul 28 01:25:28.623356 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623268 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 01:25:28.623573 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623551 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 01:25:28.623573 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.623575 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 01:25:28.626107 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.626087 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 01:25:28.628329 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.628316 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 01:25:28.628378 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.628346 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 01:25:28.630275 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630262 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 01:25:28.630309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630282 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 01:25:28.630309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630289 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 01:25:28.630309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630294 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 01:25:28.630309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630302 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 01:25:28.630309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630308 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630315 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630320 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630326 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630332 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630346 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 01:25:28.630436 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.630351 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 01:25:28.631190 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.631176 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 01:25:28.631227 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.631194 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 01:25:28.634132 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.634119 2582 server.go:1268] "Started kubelet" Jul 28 01:25:28.634219 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.634193 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 01:25:28.639169 ip-10-0-138-146 systemd[1]: Started Kubernetes Kubelet. Jul 28 01:25:28.639475 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.639177 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 01:25:28.640869 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.634234 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 01:25:28.640978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.640883 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 28 01:25:28.640978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.640893 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 01:25:28.642655 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.642626 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 01:25:28.642805 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.642778 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 01:25:28.643285 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.643243 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 01:25:28.645202 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.645184 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 01:25:28.646712 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.645701 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-146.ec2.internal.18c64fb21893b8a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-146.ec2.internal,UID:ip-10-0-138-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-146.ec2.internal,},FirstTimestamp:2026-07-28 01:25:28.634087588 +0000 UTC m=+0.389918118,LastTimestamp:2026-07-28 01:25:28.634087588 +0000 UTC m=+0.389918118,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-146.ec2.internal,}" Jul 28 01:25:28.653944 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.653928 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 01:25:28.654035 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.653947 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 01:25:28.654167 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.654145 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:28.654639 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654621 2582 factory.go:55] Registering systemd factory Jul 28 01:25:28.654639 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654643 2582 factory.go:223] Registration of the systemd container factory successfully Jul 28 01:25:28.654776 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654751 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 01:25:28.654776 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654765 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 01:25:28.654873 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654780 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 01:25:28.654873 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654844 2582 factory.go:153] Registering CRI-O factory Jul 28 01:25:28.654981 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654882 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 28 01:25:28.654981 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654889 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 28 01:25:28.654981 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.654922 2582 factory.go:223] Registration of the crio container factory successfully Jul 28 01:25:28.655110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.655012 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 01:25:28.655110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.655034 2582 factory.go:103] Registering Raw factory Jul 28 01:25:28.655110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.655048 2582 manager.go:1196] Started watching for new ooms in manager Jul 28 01:25:28.655467 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.655451 2582 manager.go:349] Starting recovery of all containers Jul 28 01:25:28.655968 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.655916 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 01:25:28.663164 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.663119 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8csdn" Jul 28 01:25:28.665350 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.664873 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 01:25:28.665909 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.665885 2582 manager.go:354] Recovery completed Jul 28 01:25:28.668222 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.668122 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8csdn" Jul 28 01:25:28.669837 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.669826 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.671664 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.671649 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.671717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.671676 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.671717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.671686 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.672226 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672209 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 01:25:28.672226 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672223 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 01:25:28.672329 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672227 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.672329 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672237 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 01:25:28.672932 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672915 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.673053 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672943 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.673053 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.672970 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.674300 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.674287 2582 policy_none.go:49] "None policy: Start" Jul 28 01:25:28.674352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.674303 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 01:25:28.674352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.674313 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 01:25:28.675326 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.675314 2582 policy_none.go:47] "Start" Jul 28 01:25:28.709533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709512 2582 manager.go:337] "Starting Device Plugin manager" Jul 28 01:25:28.709623 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.709545 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 01:25:28.709623 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709559 2582 server.go:87] "Starting device plugin registration server" Jul 28 01:25:28.709780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709766 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 01:25:28.709835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709782 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 01:25:28.709905 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709886 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 01:25:28.709991 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709971 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 01:25:28.709991 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.709980 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 01:25:28.710421 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.710398 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 01:25:28.710514 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.710454 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:28.724885 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.724861 2582 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2615 into the system container \"/system.slice\": " Jul 28 01:25:28.797838 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.797815 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 01:25:28.799027 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.799013 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 01:25:28.799105 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.799052 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 01:25:28.799105 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.799071 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 01:25:28.799105 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.799103 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 01:25:28.801445 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.801429 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 01:25:28.810155 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.810142 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.810851 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.810837 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.810919 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.810861 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.810919 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.810871 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.810919 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.810889 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.822022 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.821984 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.822022 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.822002 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-146.ec2.internal\": node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:28.844859 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.844841 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:28.899547 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.899527 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"] Jul 28 01:25:28.899615 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.899589 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.900432 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.900418 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.900494 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.900438 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.900494 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.900452 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.901926 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.901912 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.902057 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902042 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.902114 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902077 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.902532 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902519 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.902601 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902546 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.902601 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902561 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.902601 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902523 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.902746 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902614 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.902746 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.902634 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.903717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.903701 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.903753 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.903733 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 01:25:28.904371 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.904357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 28 01:25:28.904431 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.904381 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 01:25:28.904431 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.904390 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 28 01:25:28.922568 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.922548 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.926389 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.926373 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.945745 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:28.945727 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:28.956710 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.956690 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.956788 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.956714 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:28.956788 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:28.956739 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.045852 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.045825 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.057171 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.057251 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.057251 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057246 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.057321 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.057321 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057229 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.057321 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.057289 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.146587 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.146542 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.225069 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.225053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.229041 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.228989 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:29.246884 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.246854 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.347455 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.347429 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.447999 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.447941 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.548441 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.548417 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.586103 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.586081 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 01:25:29.586447 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.586212 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 01:25:29.648713 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.648684 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.673717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.673677 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 01:20:29 +0000 UTC" deadline="2028-01-16 07:57:31.295385201 +0000 UTC" Jul 28 01:25:29.673717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.673715 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12894h32m1.621673557s" Jul 28 01:25:29.747424 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:29.747379 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb1ab675b74af15fe9c3bb2fade2db2.slice/crio-20c9fbf027486c8514352923a25b42a8ce0ad7a55bd7cbaa012722835b69efb3 WatchSource:0}: Error finding container 20c9fbf027486c8514352923a25b42a8ce0ad7a55bd7cbaa012722835b69efb3: Status 404 returned error can't find the container with id 20c9fbf027486c8514352923a25b42a8ce0ad7a55bd7cbaa012722835b69efb3 Jul 28 01:25:29.748513 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:29.748489 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de2163f97d96577b1944d1e86114197.slice/crio-8fc7f48f622f9d9a78df4ad30dbe83165ff4847b0dd0aaf25161684f8121e7d2 WatchSource:0}: Error finding container 8fc7f48f622f9d9a78df4ad30dbe83165ff4847b0dd0aaf25161684f8121e7d2: Status 404 returned error can't find the container with id 8fc7f48f622f9d9a78df4ad30dbe83165ff4847b0dd0aaf25161684f8121e7d2 Jul 28 01:25:29.749650 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.749632 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.752956 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.752939 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 01:25:29.803134 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.803087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerStarted","Data":"20c9fbf027486c8514352923a25b42a8ce0ad7a55bd7cbaa012722835b69efb3"} Jul 28 01:25:29.804108 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.804083 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"7de2163f97d96577b1944d1e86114197","Type":"ContainerStarted","Data":"8fc7f48f622f9d9a78df4ad30dbe83165ff4847b0dd0aaf25161684f8121e7d2"} Jul 28 01:25:29.852995 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.852977 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.858822 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.858806 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 01:25:29.953845 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:29.953824 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:29.955317 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:29.955299 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 01:25:30.054243 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.054195 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 28 01:25:30.056555 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.056541 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 01:25:30.154722 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.154699 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 28 01:25:30.165555 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.165529 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 01:25:30.166631 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.166615 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 28 01:25:30.179499 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.179478 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 01:25:30.576121 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.576093 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 01:25:30.624468 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.624445 2582 apiserver.go:52] "Watching apiserver" Jul 28 01:25:30.634289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.634264 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 01:25:30.635386 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.635353 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vzz62","kube-system/konnectivity-agent-d7f6c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk","openshift-image-registry/node-ca-44zng","openshift-multus/multus-additional-cni-plugins-2hbx5","openshift-multus/multus-mhz2n","openshift-multus/network-metrics-daemon-bncwf","openshift-network-diagnostics/network-check-target-jnfwc","kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nzgsc","openshift-dns/node-resolver-wj5md","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal","openshift-network-operator/iptables-alerter-r6mj8","openshift-ovn-kubernetes/ovnkube-node-29fkx"] Jul 28 01:25:30.637299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.637277 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.637388 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.637363 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:30.638758 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.638734 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.640281 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.640203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.641537 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.641512 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.641537 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.641515 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 01:25:30.641744 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.641725 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.641852 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.641761 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.642006 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.641985 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-24n92\"" Jul 28 01:25:30.642550 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.642508 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 01:25:30.643484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.642906 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.643484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.642989 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d9zmp\"" Jul 28 01:25:30.643484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.642912 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.643484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.643099 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.644413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.644073 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pr6f5\"" Jul 28 01:25:30.644413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.644205 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 01:25:30.644413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.644243 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.644413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.644274 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.645298 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.645277 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.645949 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.645927 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 01:25:30.646201 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.646186 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 01:25:30.646759 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.646384 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zc97n\"" Jul 28 01:25:30.646759 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.646572 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.646759 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.646604 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.646918 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.646771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 01:25:30.647582 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.647423 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 01:25:30.647582 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.647444 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.647726 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.647686 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rbp2\"" Jul 28 01:25:30.649756 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.649610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.650351 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.650202 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 01:25:30.650513 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.650497 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.650582 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.650560 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:30.651330 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651299 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 01:25:30.651330 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651323 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.651548 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651525 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 01:25:30.651623 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651585 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z97hf\"" Jul 28 01:25:30.651700 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651535 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 01:25:30.651871 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.651853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.653217 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.653198 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.655776 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.655177 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 01:25:30.655776 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.655770 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 01:25:30.656034 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.655883 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b7vs8\"" Jul 28 01:25:30.656034 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.656010 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 01:25:30.657300 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.657275 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.657600 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.657581 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.659135 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.658424 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.659135 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.658543 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6g28l\"" Jul 28 01:25:30.661050 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.660968 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:30.661050 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.660983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 01:25:30.661205 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.661046 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:30.661205 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.661135 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l98wn\"" Jul 28 01:25:30.661690 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.661673 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 01:25:30.666101 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666065 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.666101 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666096 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666114 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-systemd-units\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666140 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-system-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-multus-daemon-config\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-config\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc880e44-66fc-4122-99ee-a232d15fcae0-ovn-node-metrics-cert\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64665e99-9108-4365-aa0f-4325cc8cbe18-hosts-file\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.666289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/620b65eb-14e4-41d2-b7f0-06680ca829d9-konnectivity-ca\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666292 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-conf\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-systemd\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-cnibin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-bin\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666459 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-dbus\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-kubernetes\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-lib-modules\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-tmp\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.666632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjmw9\" (UniqueName: \"kubernetes.io/projected/ce6f34af-1c37-47de-aa81-52b6b42a3795-kube-api-access-kjmw9\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-socket-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-k8s-cni-cncf-io\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-systemd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-env-overrides\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-sys-fs\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-bin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-slash\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.666964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-script-lib\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667051 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-sys\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667075 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-host\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7qhr\" (UniqueName: \"kubernetes.io/projected/82c2d09f-0199-4764-875a-6076c6e62020-kube-api-access-l7qhr\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.667113 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-netns\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667151 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-kubelet\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbn47\" (UniqueName: \"kubernetes.io/projected/38a8bcee-a987-4016-8975-d8f0d090f483-kube-api-access-hbn47\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-tuned\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667279 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-registration-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-multus\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-conf-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667376 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-iptables-alerter-script\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667427 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-socket-dir-parent\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkqx4\" (UniqueName: \"kubernetes.io/projected/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-kube-api-access-jkqx4\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cnibin\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-kubelet-config\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-var-lib-kubelet\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.668127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667594 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccede81a-d0c8-4075-8d79-0fc727895039-serviceca\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-multus-certs\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6z8g\" (UniqueName: \"kubernetes.io/projected/64665e99-9108-4365-aa0f-4325cc8cbe18-kube-api-access-c6z8g\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysconfig\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667789 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-hostroot\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-ovn\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-log-socket\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64665e99-9108-4365-aa0f-4325cc8cbe18-tmp-dir\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667882 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmjrn\" (UniqueName: \"kubernetes.io/projected/d5c99969-e97a-4b0b-a501-35177279e3d2-kube-api-access-fmjrn\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-etc-kubernetes\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667919 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-node-log\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.667974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-system-cni-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-os-release\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.668957 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668062 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-modprobe-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-netns\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-run\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-host-slash\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/620b65eb-14e4-41d2-b7f0-06680ca829d9-agent-certs\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-etc-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pmw\" (UniqueName: \"kubernetes.io/projected/dc880e44-66fc-4122-99ee-a232d15fcae0-kube-api-access-m5pmw\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-device-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9j8r\" (UniqueName: \"kubernetes.io/projected/ccede81a-d0c8-4075-8d79-0fc727895039-kube-api-access-z9j8r\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-cni-binary-copy\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-kubelet\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-var-lib-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbnkr\" (UniqueName: \"kubernetes.io/projected/880c37b5-d95f-469e-ad50-c7d0d4856ce1-kube-api-access-zbnkr\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccede81a-d0c8-4075-8d79-0fc727895039-host\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.669893 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-os-release\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.670811 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.668528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-netd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.690773 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.690645 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7qh9" Jul 28 01:25:30.698673 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.698641 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7qh9" Jul 28 01:25:30.756350 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.756324 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 01:25:30.769214 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64665e99-9108-4365-aa0f-4325cc8cbe18-tmp-dir\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.769331 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmjrn\" (UniqueName: \"kubernetes.io/projected/d5c99969-e97a-4b0b-a501-35177279e3d2-kube-api-access-fmjrn\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.769331 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-etc-kubernetes\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.769331 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-node-log\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.769331 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-system-cni-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.769331 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-os-release\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-modprobe-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-netns\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-run\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-host-slash\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769527 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64665e99-9108-4365-aa0f-4325cc8cbe18-tmp-dir\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.769621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/620b65eb-14e4-41d2-b7f0-06680ca829d9-agent-certs\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-etc-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pmw\" (UniqueName: \"kubernetes.io/projected/dc880e44-66fc-4122-99ee-a232d15fcae0-kube-api-access-m5pmw\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-device-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769719 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9j8r\" (UniqueName: \"kubernetes.io/projected/ccede81a-d0c8-4075-8d79-0fc727895039-kube-api-access-z9j8r\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769780 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-etc-kubernetes\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-cni-binary-copy\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-kubelet\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-var-lib-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769884 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-run\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769932 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-node-log\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbnkr\" (UniqueName: \"kubernetes.io/projected/880c37b5-d95f-469e-ad50-c7d0d4856ce1-kube-api-access-zbnkr\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccede81a-d0c8-4075-8d79-0fc727895039-host\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-host-slash\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-os-release\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-netd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770076 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-systemd-units\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770161 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-system-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-multus-daemon-config\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-config\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770249 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc880e44-66fc-4122-99ee-a232d15fcae0-ovn-node-metrics-cert\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64665e99-9108-4365-aa0f-4325cc8cbe18-hosts-file\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/620b65eb-14e4-41d2-b7f0-06680ca829d9-konnectivity-ca\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-conf\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770321 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-netns\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-systemd\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-cnibin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-bin\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770407 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-cni-binary-copy\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769929 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.769867 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770452 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-modprobe-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770480 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-device-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.770812 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770514 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-etc-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-system-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770626 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-system-cni-dir\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770718 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-os-release\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770771 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-kubelet\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770818 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-var-lib-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770863 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccede81a-d0c8-4075-8d79-0fc727895039-host\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-dbus\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-os-release\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-kubernetes\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.770976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-lib-modules\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-tmp\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjmw9\" (UniqueName: \"kubernetes.io/projected/ce6f34af-1c37-47de-aa81-52b6b42a3795-kube-api-access-kjmw9\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-socket-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-k8s-cni-cncf-io\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-systemd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-env-overrides\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.771420 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-sys-fs\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-bin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-slash\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-script-lib\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-sys\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-host\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7qhr\" (UniqueName: \"kubernetes.io/projected/82c2d09f-0199-4764-875a-6076c6e62020-kube-api-access-l7qhr\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38a8bcee-a987-4016-8975-d8f0d090f483-multus-daemon-config\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771498 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-netns\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771523 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-kubelet\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbn47\" (UniqueName: \"kubernetes.io/projected/38a8bcee-a987-4016-8975-d8f0d090f483-kube-api-access-hbn47\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-systemd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/620b65eb-14e4-41d2-b7f0-06680ca829d9-konnectivity-ca\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.772005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-run-ovn-kubernetes\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771629 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-netd\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-tuned\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771676 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-systemd-units\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-registration-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-multus\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-conf\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-conf-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771784 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-iptables-alerter-script\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771819 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-cnibin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-socket-dir-parent\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771850 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-cni-bin\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkqx4\" (UniqueName: \"kubernetes.io/projected/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-kube-api-access-jkqx4\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.772780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771932 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-dbus\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cnibin\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771974 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-kubelet-config\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771978 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-kubernetes\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-var-lib-kubelet\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772004 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-config\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccede81a-d0c8-4075-8d79-0fc727895039-serviceca\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772089 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-var-lib-kubelet\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-multus-certs\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772161 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z8g\" (UniqueName: \"kubernetes.io/projected/64665e99-9108-4365-aa0f-4325cc8cbe18-kube-api-access-c6z8g\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysconfig\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-hostroot\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-ovn\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-log-socket\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.773732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772315 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772438 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-env-overrides\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772501 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-cni-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772545 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-multus-certs\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64665e99-9108-4365-aa0f-4325cc8cbe18-hosts-file\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772855 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccede81a-d0c8-4075-8d79-0fc727895039-serviceca\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772941 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-registration-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772991 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-multus\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773053 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-conf-dir\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773201 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773276 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.773292 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.773358 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.773363 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:31.273340952 +0000 UTC m=+3.029171467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.773416 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:31.273400864 +0000 UTC m=+3.029231356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773471 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-sys-fs\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.774611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773520 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-cni-bin\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysconfig\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773568 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-host-slash\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773596 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-iptables-alerter-script\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-hostroot\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.771787 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-systemd\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773661 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-ovn\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.773709 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-log-socket\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774091 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc880e44-66fc-4122-99ee-a232d15fcae0-ovnkube-script-lib\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774125 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-sysctl-d\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774209 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-multus-socket-dir-parent\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774251 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-sys\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774297 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-host\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc880e44-66fc-4122-99ee-a232d15fcae0-run-openvswitch\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774375 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-var-lib-kubelet\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8a4c694-c114-4bcf-8628-ae43f2540b74-kubelet-config\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774629 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/880c37b5-d95f-469e-ad50-c7d0d4856ce1-cnibin\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.775569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.772440 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5c99969-e97a-4b0b-a501-35177279e3d2-lib-modules\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.776610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774720 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c2d09f-0199-4764-875a-6076c6e62020-socket-dir\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.776610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774867 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-netns\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.776610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.774887 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38a8bcee-a987-4016-8975-d8f0d090f483-host-run-k8s-cni-cncf-io\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.776610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.776040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-tmp\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.776610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.776348 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc880e44-66fc-4122-99ee-a232d15fcae0-ovn-node-metrics-cert\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.776920 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.776766 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/620b65eb-14e4-41d2-b7f0-06680ca829d9-agent-certs\") pod \"konnectivity-agent-d7f6c\" (UID: \"620b65eb-14e4-41d2-b7f0-06680ca829d9\") " pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:30.781055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.779599 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5c99969-e97a-4b0b-a501-35177279e3d2-etc-tuned\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.783178 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.782456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmjrn\" (UniqueName: \"kubernetes.io/projected/d5c99969-e97a-4b0b-a501-35177279e3d2-kube-api-access-fmjrn\") pod \"tuned-nzgsc\" (UID: \"d5c99969-e97a-4b0b-a501-35177279e3d2\") " pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:30.783178 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.783006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbnkr\" (UniqueName: \"kubernetes.io/projected/880c37b5-d95f-469e-ad50-c7d0d4856ce1-kube-api-access-zbnkr\") pod \"multus-additional-cni-plugins-2hbx5\" (UID: \"880c37b5-d95f-469e-ad50-c7d0d4856ce1\") " pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.784478 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.784452 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9j8r\" (UniqueName: \"kubernetes.io/projected/ccede81a-d0c8-4075-8d79-0fc727895039-kube-api-access-z9j8r\") pod \"node-ca-44zng\" (UID: \"ccede81a-d0c8-4075-8d79-0fc727895039\") " pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.786123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.784818 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pmw\" (UniqueName: \"kubernetes.io/projected/dc880e44-66fc-4122-99ee-a232d15fcae0-kube-api-access-m5pmw\") pod \"ovnkube-node-29fkx\" (UID: \"dc880e44-66fc-4122-99ee-a232d15fcae0\") " pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:30.787794 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.787763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjmw9\" (UniqueName: \"kubernetes.io/projected/ce6f34af-1c37-47de-aa81-52b6b42a3795-kube-api-access-kjmw9\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:30.788567 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.788543 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkqx4\" (UniqueName: \"kubernetes.io/projected/b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e-kube-api-access-jkqx4\") pod \"iptables-alerter-r6mj8\" (UID: \"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e\") " pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.788654 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.788551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6z8g\" (UniqueName: \"kubernetes.io/projected/64665e99-9108-4365-aa0f-4325cc8cbe18-kube-api-access-c6z8g\") pod \"node-resolver-wj5md\" (UID: \"64665e99-9108-4365-aa0f-4325cc8cbe18\") " pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:30.789858 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.789835 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7qhr\" (UniqueName: \"kubernetes.io/projected/82c2d09f-0199-4764-875a-6076c6e62020-kube-api-access-l7qhr\") pod \"aws-ebs-csi-driver-node-gnfvk\" (UID: \"82c2d09f-0199-4764-875a-6076c6e62020\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.790044 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.790008 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbn47\" (UniqueName: \"kubernetes.io/projected/38a8bcee-a987-4016-8975-d8f0d090f483-kube-api-access-hbn47\") pod \"multus-mhz2n\" (UID: \"38a8bcee-a987-4016-8975-d8f0d090f483\") " pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.873559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.873495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:30.882122 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.882098 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:30.882122 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.882121 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:30.882288 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.882132 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:30.882288 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:30.882188 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:31.382171624 +0000 UTC m=+3.138002127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:30.956591 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.956562 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6mj8" Jul 28 01:25:30.963533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.963512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" Jul 28 01:25:30.974313 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.974292 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44zng" Jul 28 01:25:30.981997 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.981970 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" Jul 28 01:25:30.989860 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.989838 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhz2n" Jul 28 01:25:30.998769 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:30.998747 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:31.006637 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.006615 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:31.014456 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.014440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" Jul 28 01:25:31.021269 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.021253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wj5md" Jul 28 01:25:31.277080 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.277007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:31.277080 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.277053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:31.277295 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.277164 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:31.277295 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.277182 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:31.277295 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.277234 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:32.27720848 +0000 UTC m=+4.033038972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:31.277295 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.277272 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:32.27724362 +0000 UTC m=+4.033074113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:31.478539 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.478504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:31.478715 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.478696 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:31.478776 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.478722 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:31.478776 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.478732 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:31.478862 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.478788 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:32.478770253 +0000 UTC m=+4.234600760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:31.701336 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.701226 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:20:31 +0000 UTC" deadline="2028-01-21 22:03:14.169269592 +0000 UTC" Jul 28 01:25:31.701336 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.701279 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13028h37m42.467995098s" Jul 28 01:25:31.787192 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.787080 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620b65eb_14e4_41d2_b7f0_06680ca829d9.slice/crio-47f90b662f82df19da892ff9df135f2dbe58924d9776777ac4a8dfab7191984a WatchSource:0}: Error finding container 47f90b662f82df19da892ff9df135f2dbe58924d9776777ac4a8dfab7191984a: Status 404 returned error can't find the container with id 47f90b662f82df19da892ff9df135f2dbe58924d9776777ac4a8dfab7191984a Jul 28 01:25:31.788302 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.788264 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c99969_e97a_4b0b_a501_35177279e3d2.slice/crio-07c451f66262521b593bebb36ada1c83b16b7833fae9d2ed28f4fc9795d49f6a WatchSource:0}: Error finding container 07c451f66262521b593bebb36ada1c83b16b7833fae9d2ed28f4fc9795d49f6a: Status 404 returned error can't find the container with id 07c451f66262521b593bebb36ada1c83b16b7833fae9d2ed28f4fc9795d49f6a Jul 28 01:25:31.789796 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.789596 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86b2dc3_6dbe_4b4e_8b4f_eab0c42c5f8e.slice/crio-f2a85452ec0641e65bc55632c6888a569ebf1d5ed5ea78d4f8ef0f740bc30e7e WatchSource:0}: Error finding container f2a85452ec0641e65bc55632c6888a569ebf1d5ed5ea78d4f8ef0f740bc30e7e: Status 404 returned error can't find the container with id f2a85452ec0641e65bc55632c6888a569ebf1d5ed5ea78d4f8ef0f740bc30e7e Jul 28 01:25:31.790558 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.790530 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c2d09f_0199_4764_875a_6076c6e62020.slice/crio-5d6d9214ea19fef1e2c4f6bed20fd4bd685c04bf5282c493fa1dbf5147901fa3 WatchSource:0}: Error finding container 5d6d9214ea19fef1e2c4f6bed20fd4bd685c04bf5282c493fa1dbf5147901fa3: Status 404 returned error can't find the container with id 5d6d9214ea19fef1e2c4f6bed20fd4bd685c04bf5282c493fa1dbf5147901fa3 Jul 28 01:25:31.792083 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.792024 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a8bcee_a987_4016_8975_d8f0d090f483.slice/crio-a5fa437a9f714f8fe01a451704369c1ff8c28973ce385816f089959d3c932ba0 WatchSource:0}: Error finding container a5fa437a9f714f8fe01a451704369c1ff8c28973ce385816f089959d3c932ba0: Status 404 returned error can't find the container with id a5fa437a9f714f8fe01a451704369c1ff8c28973ce385816f089959d3c932ba0 Jul 28 01:25:31.794804 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.794546 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccede81a_d0c8_4075_8d79_0fc727895039.slice/crio-a128f6c38c42c9d7f9608f00e3bcb38ff46e8492b7d9f61bcce9e459b0d23869 WatchSource:0}: Error finding container a128f6c38c42c9d7f9608f00e3bcb38ff46e8492b7d9f61bcce9e459b0d23869: Status 404 returned error can't find the container with id a128f6c38c42c9d7f9608f00e3bcb38ff46e8492b7d9f61bcce9e459b0d23869 Jul 28 01:25:31.795094 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.795057 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc880e44_66fc_4122_99ee_a232d15fcae0.slice/crio-12182e59fb3e09862b7f0def89a5d68663456bdb538adda4a0d6dec3e159d117 WatchSource:0}: Error finding container 12182e59fb3e09862b7f0def89a5d68663456bdb538adda4a0d6dec3e159d117: Status 404 returned error can't find the container with id 12182e59fb3e09862b7f0def89a5d68663456bdb538adda4a0d6dec3e159d117 Jul 28 01:25:31.796205 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.796098 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64665e99_9108_4365_aa0f_4325cc8cbe18.slice/crio-ca4adbc838be8ee37df4f7239dc850199c0a6514ca0e8ae3757dfd51f77a4a1b WatchSource:0}: Error finding container ca4adbc838be8ee37df4f7239dc850199c0a6514ca0e8ae3757dfd51f77a4a1b: Status 404 returned error can't find the container with id ca4adbc838be8ee37df4f7239dc850199c0a6514ca0e8ae3757dfd51f77a4a1b Jul 28 01:25:31.797789 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:25:31.797710 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880c37b5_d95f_469e_ad50_c7d0d4856ce1.slice/crio-0c400f3a4659d3833cbb9e7e36c2ef3558d5f503870cd91c7783d8c8fd4f45ca WatchSource:0}: Error finding container 0c400f3a4659d3833cbb9e7e36c2ef3558d5f503870cd91c7783d8c8fd4f45ca: Status 404 returned error can't find the container with id 0c400f3a4659d3833cbb9e7e36c2ef3558d5f503870cd91c7783d8c8fd4f45ca Jul 28 01:25:31.799239 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.799218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:31.799380 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:31.799350 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:31.808151 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.808125 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"12182e59fb3e09862b7f0def89a5d68663456bdb538adda4a0d6dec3e159d117"} Jul 28 01:25:31.809818 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.809783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44zng" event={"ID":"ccede81a-d0c8-4075-8d79-0fc727895039","Type":"ContainerStarted","Data":"a128f6c38c42c9d7f9608f00e3bcb38ff46e8492b7d9f61bcce9e459b0d23869"} Jul 28 01:25:31.811350 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.811320 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6mj8" event={"ID":"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e","Type":"ContainerStarted","Data":"f2a85452ec0641e65bc55632c6888a569ebf1d5ed5ea78d4f8ef0f740bc30e7e"} Jul 28 01:25:31.812904 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.812879 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" event={"ID":"d5c99969-e97a-4b0b-a501-35177279e3d2","Type":"ContainerStarted","Data":"07c451f66262521b593bebb36ada1c83b16b7833fae9d2ed28f4fc9795d49f6a"} Jul 28 01:25:31.814068 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.814033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d7f6c" event={"ID":"620b65eb-14e4-41d2-b7f0-06680ca829d9","Type":"ContainerStarted","Data":"47f90b662f82df19da892ff9df135f2dbe58924d9776777ac4a8dfab7191984a"} Jul 28 01:25:31.815304 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.815242 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhz2n" event={"ID":"38a8bcee-a987-4016-8975-d8f0d090f483","Type":"ContainerStarted","Data":"a5fa437a9f714f8fe01a451704369c1ff8c28973ce385816f089959d3c932ba0"} Jul 28 01:25:31.816673 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.816646 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" event={"ID":"82c2d09f-0199-4764-875a-6076c6e62020","Type":"ContainerStarted","Data":"5d6d9214ea19fef1e2c4f6bed20fd4bd685c04bf5282c493fa1dbf5147901fa3"} Jul 28 01:25:31.817986 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.817959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerStarted","Data":"0c400f3a4659d3833cbb9e7e36c2ef3558d5f503870cd91c7783d8c8fd4f45ca"} Jul 28 01:25:31.819168 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:31.819141 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wj5md" event={"ID":"64665e99-9108-4365-aa0f-4325cc8cbe18","Type":"ContainerStarted","Data":"ca4adbc838be8ee37df4f7239dc850199c0a6514ca0e8ae3757dfd51f77a4a1b"} Jul 28 01:25:32.284889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.284572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:32.284889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.284880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:32.285142 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.284725 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:32.285142 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.285020 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:34.284997941 +0000 UTC m=+6.040828441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:32.285142 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.285059 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:32.285142 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.285100 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:34.285087786 +0000 UTC m=+6.040918284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:32.486398 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.486362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:32.486568 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.486529 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:32.486568 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.486548 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:32.486568 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.486561 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:32.486724 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.486618 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:34.486599295 +0000 UTC m=+6.242429794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:32.702384 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.702269 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:20:31 +0000 UTC" deadline="2028-04-28 12:57:43.588087584 +0000 UTC" Jul 28 01:25:32.702384 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.702336 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15371h32m10.885756378s" Jul 28 01:25:32.801188 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.801157 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:32.801344 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.801296 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:32.801820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.801799 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:32.801927 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:32.801906 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:32.825989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.825958 2582 generic.go:356] "Generic (PLEG): container finished" podID="4fb1ab675b74af15fe9c3bb2fade2db2" containerID="a1799e62d219bb0800af2a6827acb71fd5a8e921a88ac837900916fe623458a9" exitCode=0 Jul 28 01:25:32.826993 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.826969 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerDied","Data":"a1799e62d219bb0800af2a6827acb71fd5a8e921a88ac837900916fe623458a9"} Jul 28 01:25:32.835100 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:32.835042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"7de2163f97d96577b1944d1e86114197","Type":"ContainerStarted","Data":"e5a5cbfae8970310860e3587ce1b375583537d7bebf62c23564f604c3c2dafb4"} Jul 28 01:25:33.800699 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:33.800186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:33.800699 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:33.800330 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:33.845767 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:33.845665 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerStarted","Data":"36acee8487106fbeecabe793d62b3766445427886e554ac23fa0ac0ce3b234de"} Jul 28 01:25:33.862086 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:33.861785 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" podStartSLOduration=3.861764044 podStartE2EDuration="3.861764044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:32.86026823 +0000 UTC m=+4.616098749" watchObservedRunningTime="2026-07-28 01:25:33.861764044 +0000 UTC m=+5.617594561" Jul 28 01:25:34.301473 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:34.301435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:34.301695 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:34.301484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:34.301695 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.301627 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:34.301695 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.301692 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:38.30167038 +0000 UTC m=+10.057500874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:34.301923 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.301771 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:34.301923 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.301809 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:38.30179738 +0000 UTC m=+10.057627875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:34.502995 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:34.502956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:34.503204 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.503146 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:34.503204 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.503167 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:34.503204 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.503182 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:34.503378 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.503284 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:38.503262657 +0000 UTC m=+10.259093154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:34.802428 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:34.801684 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:34.802428 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.801811 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:34.802428 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:34.802217 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:34.802428 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:34.802335 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:35.800156 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:35.800121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:35.800346 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:35.800263 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:36.800283 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:36.800176 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:36.800727 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:36.800316 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:36.800727 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:36.800391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:36.800727 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:36.800544 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:37.800080 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:37.799640 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:37.800080 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:37.799755 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:38.336078 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:38.336048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:38.336533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:38.336085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:38.336533 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.336183 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:38.336533 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.336197 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:38.336533 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.336240 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:46.336223173 +0000 UTC m=+18.092053680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:38.336533 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.336259 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:46.33624969 +0000 UTC m=+18.092080181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:38.538034 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:38.537995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:38.538205 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.538188 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:38.538260 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.538214 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:38.538260 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.538227 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:38.538362 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.538309 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:46.538288361 +0000 UTC m=+18.294118853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:38.800834 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:38.800746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:38.801001 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.800852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:38.801903 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:38.801878 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:38.802109 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:38.802061 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:39.800016 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:39.799492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:39.800016 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:39.799622 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:40.799721 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:40.799687 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:40.799907 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:40.799817 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:40.800288 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:40.800269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:40.800646 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:40.800381 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:41.799666 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:41.799609 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:41.799835 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:41.799736 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:42.799946 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:42.799918 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:42.800332 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:42.800020 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:42.800332 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:42.800102 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:42.802843 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:42.800189 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:43.800278 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:43.800243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:43.800774 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:43.800387 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:44.799400 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:44.799308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:44.799574 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:44.799429 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:44.799574 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:44.799487 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:44.799649 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:44.799606 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:45.799528 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:45.799501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:45.800021 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:45.799617 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:46.398659 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:46.398551 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:46.398813 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:46.398683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:46.398813 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.398631 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:46.398813 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.398780 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:46.398813 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.398795 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:02.39877373 +0000 UTC m=+34.154604255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:25:46.399065 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.398820 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:02.398808276 +0000 UTC m=+34.154638768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:25:46.599618 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:46.599596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:46.599726 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.599714 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:25:46.599777 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.599732 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:25:46.599777 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.599741 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:46.599837 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.599787 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:02.599773941 +0000 UTC m=+34.355604432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:25:46.799859 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:46.799795 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:46.800304 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:46.799795 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:46.800304 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.799901 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:46.800304 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:46.800020 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:47.799395 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:47.799360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:47.799561 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:47.799462 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:48.802501 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:48.802474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:48.802944 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:48.802474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:48.802944 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:48.802572 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:48.802944 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:48.802652 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:49.799724 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:49.799692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:49.799892 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:49.799816 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:50.802802 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.802372 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:50.803507 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.802420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:50.803507 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:50.802927 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:50.803507 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:50.803023 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:50.886786 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.886762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wj5md" event={"ID":"64665e99-9108-4365-aa0f-4325cc8cbe18","Type":"ContainerStarted","Data":"934efe6a5f425a95c44e7782d654a7062c401d8b4aa7bbca0dd0bcf9efc56345"} Jul 28 01:25:50.888632 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.888611 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"5aadd7a2a132262721066abeeba487919ca61766337e963da638c023cb72b68e"} Jul 28 01:25:50.888723 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.888682 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"aba38a4a353e209f41e69b9198b59bf2ca6d5362d37c07b6e466aa32e6e5aaf7"} Jul 28 01:25:50.888789 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.888732 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"7bdcec68422ce5181e555cb7a1c14d90d2b1e6eb19d83441c76e3d61a39b6994"} Jul 28 01:25:50.889997 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.889975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44zng" event={"ID":"ccede81a-d0c8-4075-8d79-0fc727895039","Type":"ContainerStarted","Data":"44878b4b4a474b8107c0e1a08e9b71d77eecbaf1d84c3ef4cf44e08d33b59d9e"} Jul 28 01:25:50.891260 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.891224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" event={"ID":"d5c99969-e97a-4b0b-a501-35177279e3d2","Type":"ContainerStarted","Data":"4be3020a8bb47f753006316b27727f8cbffb0bc3f7708b51c624d82ebe301c7a"} Jul 28 01:25:50.892526 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.892499 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d7f6c" event={"ID":"620b65eb-14e4-41d2-b7f0-06680ca829d9","Type":"ContainerStarted","Data":"aaf252accc42e89675beada25c6dfa56effa407bafef431d6c18d25a21b715d6"} Jul 28 01:25:50.893752 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.893735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhz2n" event={"ID":"38a8bcee-a987-4016-8975-d8f0d090f483","Type":"ContainerStarted","Data":"908c0fe80d23203dcd39768d677d1f8c614616c5e2c0a28b9fbd1eefe3f3a5d5"} Jul 28 01:25:50.894879 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.894855 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" event={"ID":"82c2d09f-0199-4764-875a-6076c6e62020","Type":"ContainerStarted","Data":"0c3fbcc16bf2ff07af279da18a3cf1e2c6f31bc2e46dc1c9b499375aa3153242"} Jul 28 01:25:50.896115 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.896094 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="565a62f65f273ce764453b719b22078948bc6c6221d993d52931248636e2ddf7" exitCode=0 Jul 28 01:25:50.896197 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.896120 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"565a62f65f273ce764453b719b22078948bc6c6221d993d52931248636e2ddf7"} Jul 28 01:25:50.900532 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.900496 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wj5md" podStartSLOduration=3.228194792 podStartE2EDuration="21.900484389s" totalImagesPullingTime="18.672289597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:50.899921759 +0000 UTC m=+22.655752287" watchObservedRunningTime="2026-07-28 01:25:50.900484389 +0000 UTC m=+22.656314902" Jul 28 01:25:50.900612 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.900582 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" podStartSLOduration=20.900576933 podStartE2EDuration="20.900576933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:33.862168411 +0000 UTC m=+5.617998930" watchObservedRunningTime="2026-07-28 01:25:50.900576933 +0000 UTC m=+22.656407445" Jul 28 01:25:50.945075 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.945037 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44zng" podStartSLOduration=3.277671025 podStartE2EDuration="21.94502484s" totalImagesPullingTime="18.667353815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:50.944714223 +0000 UTC m=+22.700544735" watchObservedRunningTime="2026-07-28 01:25:50.94502484 +0000 UTC m=+22.700855354" Jul 28 01:25:50.960006 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.959973 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nzgsc" podStartSLOduration=3.273914268 podStartE2EDuration="21.959943506s" totalImagesPullingTime="18.686029238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:50.959706169 +0000 UTC m=+22.715536681" watchObservedRunningTime="2026-07-28 01:25:50.959943506 +0000 UTC m=+22.715774019" Jul 28 01:25:50.974789 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.974759 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhz2n" podStartSLOduration=3.247234228 podStartE2EDuration="21.974748036s" totalImagesPullingTime="18.727513808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:50.974485015 +0000 UTC m=+22.730315528" watchObservedRunningTime="2026-07-28 01:25:50.974748036 +0000 UTC m=+22.730578548" Jul 28 01:25:50.996042 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:50.996006 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d7f6c" podStartSLOduration=7.205167779 podStartE2EDuration="21.99599475s" totalImagesPullingTime="14.790826971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:50.995702377 +0000 UTC m=+22.751532902" watchObservedRunningTime="2026-07-28 01:25:50.99599475 +0000 UTC m=+22.751825262" Jul 28 01:25:51.800260 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.800235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:51.800415 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:51.800333 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:51.901979 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.901902 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"916d5219fa280a61693de9152871bd86e6d6c8a8832966c980ab3a2083e802fe"} Jul 28 01:25:51.902319 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.902004 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"f75bcbd4e7435c811909f5e758c68a6dad9c01aee08bdbd69faf6fa34fb58aab"} Jul 28 01:25:51.902319 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.902061 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"e4649516ab5e7323e2d2286e4ab0d7b85e6122c8e0af333b769d033a5a1d0046"} Jul 28 01:25:51.903413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.903391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6mj8" event={"ID":"b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e","Type":"ContainerStarted","Data":"9873d4b4ed0c70d8c104dbe9062fa629a9d95f8e7170d7e0a6f44150613b44b2"} Jul 28 01:25:51.917610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.917562 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r6mj8" podStartSLOduration=4.250104597 podStartE2EDuration="22.917543708s" totalImagesPullingTime="18.667439111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:51.917106426 +0000 UTC m=+23.672936938" watchObservedRunningTime="2026-07-28 01:25:51.917543708 +0000 UTC m=+23.673374222" Jul 28 01:25:51.962371 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:51.962353 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 01:25:52.723844 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.723734 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:25:51.962369049Z","UUID":"cda165f3-9b4a-4b98-a91e-e46fa1c6da53","Handler":null,"Name":"","Endpoint":""} Jul 28 01:25:52.726260 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.726224 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 01:25:52.726386 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.726296 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 01:25:52.764651 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.764622 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:52.765276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.765251 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:52.799568 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.799494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:52.799686 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:52.799617 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:52.799686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.799665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:52.799838 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:52.799812 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:52.907865 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.907830 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" event={"ID":"82c2d09f-0199-4764-875a-6076c6e62020","Type":"ContainerStarted","Data":"c5dc47e11cbfb6fdcaea68dc04c32dc6ee1dd712b4e5c52d1c7260f913f275b7"} Jul 28 01:25:52.908292 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.908128 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:52.908503 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:52.908486 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d7f6c" Jul 28 01:25:53.800215 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:53.800014 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:53.800378 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:53.800309 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:53.913974 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:53.913915 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"326d24c0fb6705c4ad477bc508dd045aec0dd3b19e1b5a22837fd28b3fa52198"} Jul 28 01:25:53.916174 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:53.916110 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" event={"ID":"82c2d09f-0199-4764-875a-6076c6e62020","Type":"ContainerStarted","Data":"3ce18ea149c0908eaa13481b083cd8885b9d448e14eb89d5e9c90117811447cc"} Jul 28 01:25:53.933927 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:53.933891 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnfvk" podStartSLOduration=3.877105557 podStartE2EDuration="24.933877218s" totalImagesPullingTime="21.056771661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:53.932695211 +0000 UTC m=+25.688525725" watchObservedRunningTime="2026-07-28 01:25:53.933877218 +0000 UTC m=+25.689707730" Jul 28 01:25:54.799529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:54.799499 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:54.799705 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:54.799600 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:54.799705 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:54.799693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:54.799837 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:54.799816 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:55.800250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.800085 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:55.800866 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:55.800355 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:55.922221 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.922193 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="2db5e7e90d8a1038e4a90c68ad2b3789c87207adce617f0d174f083989db4ffe" exitCode=0 Jul 28 01:25:55.922352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.922278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"2db5e7e90d8a1038e4a90c68ad2b3789c87207adce617f0d174f083989db4ffe"} Jul 28 01:25:55.926093 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.926074 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" event={"ID":"dc880e44-66fc-4122-99ee-a232d15fcae0","Type":"ContainerStarted","Data":"f78870b6cdf58d8136e187fbec69d758b698af4058d83f8affe62736ca5ce2e3"} Jul 28 01:25:55.926259 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.926248 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:55.926315 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.926293 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:55.942534 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.942514 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:55.964819 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:55.964781 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" podStartSLOduration=8.223028395 podStartE2EDuration="26.964768462s" totalImagesPullingTime="18.741740067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:55.964274202 +0000 UTC m=+27.720104714" watchObservedRunningTime="2026-07-28 01:25:55.964768462 +0000 UTC m=+27.720598975" Jul 28 01:25:56.799369 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:56.799333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:56.799588 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:56.799420 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:56.799588 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:56.799502 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:56.799664 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:56.799583 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:56.928815 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:56.928787 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:56.942803 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:56.942783 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:25:57.678050 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.678026 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnfwc"] Jul 28 01:25:57.678292 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.678109 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:57.678292 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:57.678180 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:57.681503 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.681477 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bncwf"] Jul 28 01:25:57.681635 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.681577 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:57.681701 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:57.681677 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:57.682220 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.682198 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzz62"] Jul 28 01:25:57.682332 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.682299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:57.682411 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:57.682390 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:57.932699 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.932632 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="741c37e8c52dd80a4b796f974a2aae2b4f17f6ce9bda9fd7d82545d94218447a" exitCode=0 Jul 28 01:25:57.933008 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:57.932710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"741c37e8c52dd80a4b796f974a2aae2b4f17f6ce9bda9fd7d82545d94218447a"} Jul 28 01:25:58.800919 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:58.800757 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:25:58.801072 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:58.800840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:25:58.801072 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:58.801005 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:25:58.801156 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:58.801095 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:25:59.800261 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:59.800191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:25:59.800661 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:25:59.800300 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:25:59.938611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:59.938584 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="295cf3755121af76f73714b47dc83f5db7df804ea8914562bbc5b18f9479a7d2" exitCode=0 Jul 28 01:25:59.938752 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:25:59.938639 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"295cf3755121af76f73714b47dc83f5db7df804ea8914562bbc5b18f9479a7d2"} Jul 28 01:26:00.800131 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:00.800097 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:00.800325 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:00.800213 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:26:00.800325 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:00.800272 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:26:00.801094 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:00.800383 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:26:01.799216 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:01.799188 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:01.799381 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:01.799287 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:26:02.422597 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:02.422564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:02.422994 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:02.422605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:26:02.422994 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.422718 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 01:26:02.422994 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.422776 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret podName:b8a4c694-c114-4bcf-8628-ae43f2540b74 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:34.422761487 +0000 UTC m=+66.178591982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret") pod "global-pull-secret-syncer-vzz62" (UID: "b8a4c694-c114-4bcf-8628-ae43f2540b74") : object "kube-system"/"original-pull-secret" not registered Jul 28 01:26:02.422994 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.422718 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:26:02.422994 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.422851 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:34.422837954 +0000 UTC m=+66.178668448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 01:26:02.624327 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:02.624235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:02.624488 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.624404 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 01:26:02.624488 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.624427 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 01:26:02.624488 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.624437 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rw9zq for pod openshift-network-diagnostics/network-check-target-jnfwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:26:02.624488 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.624483 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq podName:bdbffc66-38e4-49b5-81c5-abca4a6e5b95 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:34.624465665 +0000 UTC m=+66.380296166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9zq" (UniqueName: "kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq") pod "network-check-target-jnfwc" (UID: "bdbffc66-38e4-49b5-81c5-abca4a6e5b95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 01:26:02.799267 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:02.799238 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:02.799267 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:02.799270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:26:02.799497 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.799350 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfwc" podUID="bdbffc66-38e4-49b5-81c5-abca4a6e5b95" Jul 28 01:26:02.799497 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:02.799450 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bncwf" podUID="ce6f34af-1c37-47de-aa81-52b6b42a3795" Jul 28 01:26:03.799880 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:03.799827 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:03.800355 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:03.799996 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzz62" podUID="b8a4c694-c114-4bcf-8628-ae43f2540b74" Jul 28 01:26:03.951299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:03.951272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerStarted","Data":"f641fdef4cb8ccce7a671077b09a80ae9daa60d05bdc2571be0e56d41ad8836a"} Jul 28 01:26:04.016650 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.016623 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeReady" Jul 28 01:26:04.016747 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.016738 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 01:26:04.050887 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.050836 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:26:04.052608 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.052593 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.055094 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.055076 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 01:26:04.055199 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.055091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 01:26:04.055199 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.055157 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tgrjr\"" Jul 28 01:26:04.055471 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.055456 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 01:26:04.060801 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.060781 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 01:26:04.065934 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.065910 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5jgcm"] Jul 28 01:26:04.068901 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.068882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:26:04.069008 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.068911 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qsp9t"] Jul 28 01:26:04.069051 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.069008 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.070987 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.070972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.071364 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.071345 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 01:26:04.071435 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.071378 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtm4s\"" Jul 28 01:26:04.071435 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.071409 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 01:26:04.073270 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.073257 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 01:26:04.073337 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.073321 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 01:26:04.073488 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.073471 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t6tn5\"" Jul 28 01:26:04.073946 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.073926 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 01:26:04.078814 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.078793 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5jgcm"] Jul 28 01:26:04.081980 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.081943 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsp9t"] Jul 28 01:26:04.238611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhg2v\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.238710 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5df042c8-7d55-4d9e-a957-88d9d619d288-cert\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.238710 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.238710 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.238710 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238697 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.238848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.238848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-config-volume\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.238848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-tmp-dir\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.238848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm9dx\" (UniqueName: \"kubernetes.io/projected/5df042c8-7d55-4d9e-a957-88d9d619d288-kube-api-access-dm9dx\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.238848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.239015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.239015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4rt\" (UniqueName: \"kubernetes.io/projected/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-kube-api-access-sc4rt\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.239015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.239015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.238913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.339924 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.339881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhg2v\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.339924 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.339921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5df042c8-7d55-4d9e-a957-88d9d619d288-cert\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.339942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.339972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.339992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-config-volume\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.340064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-tmp-dir\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.340070 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.340136 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:04.840116311 +0000 UTC m=+36.595946809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340071 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm9dx\" (UniqueName: \"kubernetes.io/projected/5df042c8-7d55-4d9e-a957-88d9d619d288-kube-api-access-dm9dx\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.340191 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.340206 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.340283 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:04.840243305 +0000 UTC m=+36.596073814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:04.340343 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4rt\" (UniqueName: \"kubernetes.io/projected/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-kube-api-access-sc4rt\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.340754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340716 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-config-volume\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.340872 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340755 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.340872 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.340803 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-tmp-dir\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.341305 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.341183 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.341743 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.341615 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.344064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.344039 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.344141 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.344038 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.344141 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.344085 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5df042c8-7d55-4d9e-a957-88d9d619d288-cert\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.348153 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.348135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm9dx\" (UniqueName: \"kubernetes.io/projected/5df042c8-7d55-4d9e-a957-88d9d619d288-kube-api-access-dm9dx\") pod \"ingress-canary-qsp9t\" (UID: \"5df042c8-7d55-4d9e-a957-88d9d619d288\") " pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.350624 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.350601 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.350775 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.350760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4rt\" (UniqueName: \"kubernetes.io/projected/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-kube-api-access-sc4rt\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.351003 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.350987 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhg2v\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.383709 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.383690 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsp9t" Jul 28 01:26:04.508229 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.508202 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsp9t"] Jul 28 01:26:04.511533 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:04.511505 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df042c8_7d55_4d9e_a957_88d9d619d288.slice/crio-93d7984b0f06ea46dd633ac5dbbfdd0649cb7a9f92c9e8fa02631713fdcc3102 WatchSource:0}: Error finding container 93d7984b0f06ea46dd633ac5dbbfdd0649cb7a9f92c9e8fa02631713fdcc3102: Status 404 returned error can't find the container with id 93d7984b0f06ea46dd633ac5dbbfdd0649cb7a9f92c9e8fa02631713fdcc3102 Jul 28 01:26:04.799400 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.799284 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:04.799400 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.799373 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:26:04.803947 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.803801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 01:26:04.803947 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.803823 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptgdn\"" Jul 28 01:26:04.803947 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.803832 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xpqm\"" Jul 28 01:26:04.803947 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.803840 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 01:26:04.803947 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.803801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 01:26:04.843553 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.843525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:04.843667 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.843558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:04.843667 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.843658 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:04.843795 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.843668 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:04.843795 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.843739 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:05.843713898 +0000 UTC m=+37.599544390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:04.843795 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.843672 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:04.843945 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:04.843803 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:05.843791629 +0000 UTC m=+37.599622120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:04.956208 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.956170 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="f641fdef4cb8ccce7a671077b09a80ae9daa60d05bdc2571be0e56d41ad8836a" exitCode=0 Jul 28 01:26:04.956358 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.956244 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"f641fdef4cb8ccce7a671077b09a80ae9daa60d05bdc2571be0e56d41ad8836a"} Jul 28 01:26:04.957587 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:04.957327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsp9t" event={"ID":"5df042c8-7d55-4d9e-a957-88d9d619d288","Type":"ContainerStarted","Data":"93d7984b0f06ea46dd633ac5dbbfdd0649cb7a9f92c9e8fa02631713fdcc3102"} Jul 28 01:26:05.800096 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.800067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:05.802856 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.802837 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 01:26:05.854168 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.854139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.854184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:05.854298 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:05.854308 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:05.854322 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:05.854364 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:07.85434489 +0000 UTC m=+39.610175395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:05.854486 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:05.854382 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:07.854372704 +0000 UTC m=+39.610203202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:05.963407 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.963379 2582 generic.go:356] "Generic (PLEG): container finished" podID="880c37b5-d95f-469e-ad50-c7d0d4856ce1" containerID="f423305b90332cbc3376bf63e1d4094e10b27958a54386a4b1fd95de40ee9e88" exitCode=0 Jul 28 01:26:05.963536 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:05.963446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerDied","Data":"f423305b90332cbc3376bf63e1d4094e10b27958a54386a4b1fd95de40ee9e88"} Jul 28 01:26:06.968516 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:06.968343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" event={"ID":"880c37b5-d95f-469e-ad50-c7d0d4856ce1","Type":"ContainerStarted","Data":"edb87a522974e534958a518f803d3868fa23f509afc400ac29e00d211158486b"} Jul 28 01:26:06.989773 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:06.989733 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2hbx5" podStartSLOduration=8.893263951 podStartE2EDuration="37.989718763s" totalImagesPullingTime="29.096454812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:06.98869237 +0000 UTC m=+38.744522883" watchObservedRunningTime="2026-07-28 01:26:06.989718763 +0000 UTC m=+38.745549274" Jul 28 01:26:07.165478 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.165450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:07.250855 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.250823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:07.822981 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.822924 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.871107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:07.871249 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:07.871337 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:11.871311951 +0000 UTC m=+43.627142456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.871349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:07.871255 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:07.871473 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:07.873754 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:07.871531 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:11.871515601 +0000 UTC m=+43.627346105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:07.923451 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.923429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:07.971620 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.971591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsp9t" event={"ID":"5df042c8-7d55-4d9e-a957-88d9d619d288","Type":"ContainerStarted","Data":"72f6e3627f844ee5bd73837cac215b9bca5370e201a8df5aa87aec0238e413ab"} Jul 28 01:26:07.988611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:07.988555 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qsp9t" podStartSLOduration=1.317186029 podStartE2EDuration="3.988544849s" totalImagesPullingTime="2.67135882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:07.988448996 +0000 UTC m=+39.744279509" watchObservedRunningTime="2026-07-28 01:26:07.988544849 +0000 UTC m=+39.744375378" Jul 28 01:26:11.219310 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:11.219271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:11.271463 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:11.271429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:11.900305 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:11.900276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:11.900431 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:11.900316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:11.900431 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:11.900412 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:11.900519 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:11.900418 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:11.900519 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:11.900458 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:11.900519 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:11.900464 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:19.900449607 +0000 UTC m=+51.656280097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:11.900519 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:11.900492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:19.90048202 +0000 UTC m=+51.656312510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:15.880377 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:15.880337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:15.939612 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:15.939572 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:16.817608 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:16.817576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:16.918234 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:16.918209 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:18.725333 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:18.725301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:18.825742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:18.825707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:19.716226 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:19.716195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:19.770216 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:19.770188 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:19.958187 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:19.958158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:19.958317 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:19.958197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:19.958317 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:19.958308 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:19.958430 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:19.958318 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:19.958430 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:19.958333 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:19.958430 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:19.958364 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:26:35.958350339 +0000 UTC m=+67.714180831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:19.958430 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:19.958407 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:26:35.958390599 +0000 UTC m=+67.714221089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:20.733568 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:20.733537 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:20.795892 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:20.795866 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:20.847829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:20.847808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:20.997763 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:20.997741 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv"] Jul 28 01:26:21.012740 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.012711 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2"] Jul 28 01:26:21.012858 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.012840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" Jul 28 01:26:21.015069 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.015053 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rcptg\"" Jul 28 01:26:21.026717 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.026696 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl"] Jul 28 01:26:21.026849 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.026825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.029215 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.029190 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.029215 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.029209 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 01:26:21.029352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.029218 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 01:26:21.029464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.029449 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-92nzz\"" Jul 28 01:26:21.029533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.029521 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.048720 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.048702 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz"] Jul 28 01:26:21.048841 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.048826 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.051384 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.051365 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.051476 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.051412 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xvb92\"" Jul 28 01:26:21.051553 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.051480 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.051553 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.051485 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 01:26:21.052547 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.052533 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 01:26:21.065804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.065786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppzvv\" (UniqueName: \"kubernetes.io/projected/f5a01e74-8484-421d-9c8b-75f2349a377c-kube-api-access-ppzvv\") pod \"network-check-source-7d88cb55d8-jnxqv\" (UID: \"f5a01e74-8484-421d-9c8b-75f2349a377c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" Jul 28 01:26:21.065900 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.065817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.065900 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.065867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.065900 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.065890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.066054 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.066000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97cvt\" (UniqueName: \"kubernetes.io/projected/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-kube-api-access-97cvt\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.066054 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.066024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-config\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.066054 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.066043 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db7d5\" (UniqueName: \"kubernetes.io/projected/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-kube-api-access-db7d5\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.072736 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.072718 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l"] Jul 28 01:26:21.072828 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.072814 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.075353 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.075331 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.075449 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.075360 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.075449 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.075367 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mjz9f\"" Jul 28 01:26:21.075449 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.075404 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 01:26:21.088787 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088766 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv"] Jul 28 01:26:21.088875 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088795 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l"] Jul 28 01:26:21.088875 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl"] Jul 28 01:26:21.088875 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088839 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz"] Jul 28 01:26:21.089058 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088895 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" Jul 28 01:26:21.089058 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.088925 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2"] Jul 28 01:26:21.091307 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.091290 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6h9gg\"" Jul 28 01:26:21.091368 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.091309 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.091586 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.091573 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.104930 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.104913 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-v56ph"] Jul 28 01:26:21.118995 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.118977 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568"] Jul 28 01:26:21.119091 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.119077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.123529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.122528 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kxfbb\"" Jul 28 01:26:21.123529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.122664 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 01:26:21.123529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.123261 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.124465 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.123802 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 01:26:21.124668 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.124612 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.129690 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.129670 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 01:26:21.142052 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.142032 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2wjmp"] Jul 28 01:26:21.142140 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.142109 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.144386 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.144369 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.144551 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.144537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 01:26:21.144648 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.144629 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ddxtj\"" Jul 28 01:26:21.144726 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.144680 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.144726 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.144697 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 01:26:21.158275 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.158257 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-v56ph"] Jul 28 01:26:21.158351 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.158284 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568"] Jul 28 01:26:21.158351 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.158297 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2wjmp"] Jul 28 01:26:21.158351 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.158311 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85bb96f565-48h9w"] Jul 28 01:26:21.158464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.158350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.160822 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.160804 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.160822 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.160822 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 01:26:21.160989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.160810 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.160989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.160804 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 01:26:21.160989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.160811 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jn5x9\"" Jul 28 01:26:21.165746 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.165727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 01:26:21.166633 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppzvv\" (UniqueName: \"kubernetes.io/projected/f5a01e74-8484-421d-9c8b-75f2349a377c-kube-api-access-ppzvv\") pod \"network-check-source-7d88cb55d8-jnxqv\" (UID: \"f5a01e74-8484-421d-9c8b-75f2349a377c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" Jul 28 01:26:21.166709 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166641 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.166709 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-snapshots\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.166709 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r44t\" (UniqueName: \"kubernetes.io/projected/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-kube-api-access-2r44t\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-tmp\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166746 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6227d146-0d15-456b-8d7d-566c35322667-serving-cert\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xp7t\" (UniqueName: \"kubernetes.io/projected/814d9efe-b4f5-491c-9135-123a3d0c1ffe-kube-api-access-2xp7t\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.166820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.167055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166836 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-service-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.167055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166932 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.167055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.166984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.167055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.167188 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db7d5\" (UniqueName: \"kubernetes.io/projected/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-kube-api-access-db7d5\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.167188 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.167125 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:21.167188 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.167175 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:21.667162586 +0000 UTC m=+53.422993080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:21.167338 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqvb\" (UniqueName: \"kubernetes.io/projected/6d61c0d9-918f-4899-abe2-8825abb20398-kube-api-access-2wqvb\") pod \"volume-data-source-validator-549c6d54cf-w2l2l\" (UID: \"6d61c0d9-918f-4899-abe2-8825abb20398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" Jul 28 01:26:21.167338 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzm9g\" (UniqueName: \"kubernetes.io/projected/6227d146-0d15-456b-8d7d-566c35322667-kube-api-access-rzm9g\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.167440 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97cvt\" (UniqueName: \"kubernetes.io/projected/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-kube-api-access-97cvt\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.167440 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167365 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-config\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.167440 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167374 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.167890 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.167871 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-config\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.170635 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.170618 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.176321 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.176302 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4"] Jul 28 01:26:21.176431 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.176418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.178771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.178754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 01:26:21.178853 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.178814 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppzvv\" (UniqueName: \"kubernetes.io/projected/f5a01e74-8484-421d-9c8b-75f2349a377c-kube-api-access-ppzvv\") pod \"network-check-source-7d88cb55d8-jnxqv\" (UID: \"f5a01e74-8484-421d-9c8b-75f2349a377c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" Jul 28 01:26:21.178853 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.178764 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 01:26:21.178998 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.178983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 01:26:21.179120 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179105 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j5ff5\"" Jul 28 01:26:21.179193 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179163 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 01:26:21.179243 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179224 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 01:26:21.179340 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179324 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 01:26:21.179770 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179748 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db7d5\" (UniqueName: \"kubernetes.io/projected/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-kube-api-access-db7d5\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.179870 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.179850 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97cvt\" (UniqueName: \"kubernetes.io/projected/a44d4de1-3c6d-4a02-8175-c93e5fae68a1-kube-api-access-97cvt\") pod \"service-ca-operator-5d6c75f84f-gf7r2\" (UID: \"a44d4de1-3c6d-4a02-8175-c93e5fae68a1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.197713 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.197696 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4"] Jul 28 01:26:21.197778 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.197721 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bb96f565-48h9w"] Jul 28 01:26:21.197821 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.197801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.203338 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.203300 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4qs98\"" Jul 28 01:26:21.203338 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.203333 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 01:26:21.206747 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.206724 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 01:26:21.268653 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xp7t\" (UniqueName: \"kubernetes.io/projected/814d9efe-b4f5-491c-9135-123a3d0c1ffe-kube-api-access-2xp7t\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.268653 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.268653 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-trusted-ca\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca2d7844-c1fc-4899-b726-76074d454c92-serving-cert\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268770 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-service-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.268804 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8869t\" (UniqueName: \"kubernetes.io/projected/bb9613e0-54d6-4f74-be9b-971130eb0aeb-kube-api-access-8869t\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-default-certificate\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-config\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.268943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqvb\" (UniqueName: \"kubernetes.io/projected/6d61c0d9-918f-4899-abe2-8825abb20398-kube-api-access-2wqvb\") pod \"volume-data-source-validator-549c6d54cf-w2l2l\" (UID: \"6d61c0d9-918f-4899-abe2-8825abb20398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.269050 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 01:26:21.269137 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.269110 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls podName:814d9efe-b4f5-491c-9135-123a3d0c1ffe nodeName:}" failed. No retries permitted until 2026-07-28 01:26:21.769091755 +0000 UTC m=+53.524922262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls") pod "cluster-samples-operator-6748489656-5rdqz" (UID: "814d9efe-b4f5-491c-9135-123a3d0c1ffe") : secret "samples-operator-tls" not found Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzm9g\" (UniqueName: \"kubernetes.io/projected/6227d146-0d15-456b-8d7d-566c35322667-kube-api-access-rzm9g\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdjp\" (UniqueName: \"kubernetes.io/projected/ca2d7844-c1fc-4899-b726-76074d454c92-kube-api-access-hzdjp\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81c8d2d8-d0ef-413c-bed5-17213ef94469-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269353 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-snapshots\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269362 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r44t\" (UniqueName: \"kubernetes.io/projected/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-kube-api-access-2r44t\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269400 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-service-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-tmp\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-stats-auth\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6227d146-0d15-456b-8d7d-566c35322667-serving-cert\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269685 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6227d146-0d15-456b-8d7d-566c35322667-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-snapshots\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.269857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.269847 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6227d146-0d15-456b-8d7d-566c35322667-tmp\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.270835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.270812 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.271535 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.271518 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6227d146-0d15-456b-8d7d-566c35322667-serving-cert\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.282852 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.282827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqvb\" (UniqueName: \"kubernetes.io/projected/6d61c0d9-918f-4899-abe2-8825abb20398-kube-api-access-2wqvb\") pod \"volume-data-source-validator-549c6d54cf-w2l2l\" (UID: \"6d61c0d9-918f-4899-abe2-8825abb20398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" Jul 28 01:26:21.282926 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.282909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xp7t\" (UniqueName: \"kubernetes.io/projected/814d9efe-b4f5-491c-9135-123a3d0c1ffe-kube-api-access-2xp7t\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.283127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.283108 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzm9g\" (UniqueName: \"kubernetes.io/projected/6227d146-0d15-456b-8d7d-566c35322667-kube-api-access-rzm9g\") pod \"insights-operator-5885fdb759-v56ph\" (UID: \"6227d146-0d15-456b-8d7d-566c35322667\") " pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.283452 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.283434 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r44t\" (UniqueName: \"kubernetes.io/projected/8eb31a5b-4d6c-48ef-ac20-ce0d12b58965-kube-api-access-2r44t\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z9568\" (UID: \"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.322569 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.322547 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" Jul 28 01:26:21.336723 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.336704 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" Jul 28 01:26:21.369498 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.369474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:21.370292 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370277 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca2d7844-c1fc-4899-b726-76074d454c92-serving-cert\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.370374 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8869t\" (UniqueName: \"kubernetes.io/projected/bb9613e0-54d6-4f74-be9b-971130eb0aeb-kube-api-access-8869t\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.370374 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-default-certificate\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.370374 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370346 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-config\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.370559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdjp\" (UniqueName: \"kubernetes.io/projected/ca2d7844-c1fc-4899-b726-76074d454c92-kube-api-access-hzdjp\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.370559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.370559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81c8d2d8-d0ef-413c-bed5-17213ef94469-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.370559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370531 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-stats-auth\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.370559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-trusted-ca\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.370621 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.370648 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:21.870629696 +0000 UTC m=+53.626460206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.370731 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.370779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:21.870763985 +0000 UTC m=+53.626594479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.370839 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 01:26:21.370889 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.370885 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:21.870870529 +0000 UTC m=+53.626701023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : secret "router-metrics-certs-default" not found Jul 28 01:26:21.371297 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.371120 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-config\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.371556 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.371534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81c8d2d8-d0ef-413c-bed5-17213ef94469-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.371635 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.371550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7844-c1fc-4899-b726-76074d454c92-trusted-ca\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.372721 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.372706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca2d7844-c1fc-4899-b726-76074d454c92-serving-cert\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.379094 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.379073 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdjp\" (UniqueName: \"kubernetes.io/projected/ca2d7844-c1fc-4899-b726-76074d454c92-kube-api-access-hzdjp\") pod \"console-operator-584dcb6b54-2wjmp\" (UID: \"ca2d7844-c1fc-4899-b726-76074d454c92\") " pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.384544 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.384525 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-default-certificate\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.384677 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.384657 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8869t\" (UniqueName: \"kubernetes.io/projected/bb9613e0-54d6-4f74-be9b-971130eb0aeb-kube-api-access-8869t\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.384677 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.384672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-stats-auth\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.396204 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.396172 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" Jul 28 01:26:21.455609 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.454991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-v56ph" Jul 28 01:26:21.460149 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.460056 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" Jul 28 01:26:21.467412 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.467320 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:21.473409 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.473386 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:21.509704 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.509671 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv"] Jul 28 01:26:21.525297 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.525273 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2"] Jul 28 01:26:21.529642 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:21.529614 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44d4de1_3c6d_4a02_8175_c93e5fae68a1.slice/crio-bc87c147ab16d6d9458a27748926b045260bcb10a3b55f064ed0071623b40fd7 WatchSource:0}: Error finding container bc87c147ab16d6d9458a27748926b045260bcb10a3b55f064ed0071623b40fd7: Status 404 returned error can't find the container with id bc87c147ab16d6d9458a27748926b045260bcb10a3b55f064ed0071623b40fd7 Jul 28 01:26:21.534289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.532552 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:21.584523 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.584498 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l"] Jul 28 01:26:21.588207 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:21.588165 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d61c0d9_918f_4899_abe2_8825abb20398.slice/crio-cbbb1ef50447e1b9cb832f38280aff13a79d8ea9f03659b8ecfb2d635e4d0bf5 WatchSource:0}: Error finding container cbbb1ef50447e1b9cb832f38280aff13a79d8ea9f03659b8ecfb2d635e4d0bf5: Status 404 returned error can't find the container with id cbbb1ef50447e1b9cb832f38280aff13a79d8ea9f03659b8ecfb2d635e4d0bf5 Jul 28 01:26:21.635775 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.635749 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568"] Jul 28 01:26:21.638282 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:21.638251 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb31a5b_4d6c_48ef_ac20_ce0d12b58965.slice/crio-fe17ee1c112d62ee2be83f04053cf554b0051c03ee2f1a3ea5e64e08c3177912 WatchSource:0}: Error finding container fe17ee1c112d62ee2be83f04053cf554b0051c03ee2f1a3ea5e64e08c3177912: Status 404 returned error can't find the container with id fe17ee1c112d62ee2be83f04053cf554b0051c03ee2f1a3ea5e64e08c3177912 Jul 28 01:26:21.654012 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.653989 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-v56ph"] Jul 28 01:26:21.656843 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:21.656822 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6227d146_0d15_456b_8d7d_566c35322667.slice/crio-7883afd8e101f74ac5ef2f5f14737744c5d1c84da85c9ee6713f0db3451116a4 WatchSource:0}: Error finding container 7883afd8e101f74ac5ef2f5f14737744c5d1c84da85c9ee6713f0db3451116a4: Status 404 returned error can't find the container with id 7883afd8e101f74ac5ef2f5f14737744c5d1c84da85c9ee6713f0db3451116a4 Jul 28 01:26:21.668044 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.668024 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2wjmp"] Jul 28 01:26:21.674253 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.674228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:21.674380 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.674364 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:21.674440 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.674417 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:22.674403514 +0000 UTC m=+54.430234008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:21.679884 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:21.679852 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2d7844_c1fc_4899_b726_76074d454c92.slice/crio-bf25f9dfd447df063c8ae94c2447d86d6513f383f96a659b937cc8cb5103e77a WatchSource:0}: Error finding container bf25f9dfd447df063c8ae94c2447d86d6513f383f96a659b937cc8cb5103e77a: Status 404 returned error can't find the container with id bf25f9dfd447df063c8ae94c2447d86d6513f383f96a659b937cc8cb5103e77a Jul 28 01:26:21.774704 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.774649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:21.774802 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.774785 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 01:26:21.774853 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.774844 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls podName:814d9efe-b4f5-491c-9135-123a3d0c1ffe nodeName:}" failed. No retries permitted until 2026-07-28 01:26:22.774827531 +0000 UTC m=+54.530658022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls") pod "cluster-samples-operator-6748489656-5rdqz" (UID: "814d9efe-b4f5-491c-9135-123a3d0c1ffe") : secret "samples-operator-tls" not found Jul 28 01:26:21.875545 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.875517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.875565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.875683 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:21.875713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.875726 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.875736 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:22.875722158 +0000 UTC m=+54.631552653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : secret "router-metrics-certs-default" not found Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.875779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:22.875765532 +0000 UTC m=+54.631596026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:21.875909 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:21.875817 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:22.875801689 +0000 UTC m=+54.631632184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:22.003451 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.003419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-v56ph" event={"ID":"6227d146-0d15-456b-8d7d-566c35322667","Type":"ContainerStarted","Data":"7883afd8e101f74ac5ef2f5f14737744c5d1c84da85c9ee6713f0db3451116a4"} Jul 28 01:26:22.004691 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.004658 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" event={"ID":"a44d4de1-3c6d-4a02-8175-c93e5fae68a1","Type":"ContainerStarted","Data":"bc87c147ab16d6d9458a27748926b045260bcb10a3b55f064ed0071623b40fd7"} Jul 28 01:26:22.005970 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.005926 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" event={"ID":"ca2d7844-c1fc-4899-b726-76074d454c92","Type":"ContainerStarted","Data":"bf25f9dfd447df063c8ae94c2447d86d6513f383f96a659b937cc8cb5103e77a"} Jul 28 01:26:22.007124 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.007092 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" event={"ID":"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965","Type":"ContainerStarted","Data":"fe17ee1c112d62ee2be83f04053cf554b0051c03ee2f1a3ea5e64e08c3177912"} Jul 28 01:26:22.008900 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.008871 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" event={"ID":"6d61c0d9-918f-4899-abe2-8825abb20398","Type":"ContainerStarted","Data":"cbbb1ef50447e1b9cb832f38280aff13a79d8ea9f03659b8ecfb2d635e4d0bf5"} Jul 28 01:26:22.010223 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.010201 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" event={"ID":"f5a01e74-8484-421d-9c8b-75f2349a377c","Type":"ContainerStarted","Data":"76a43cb3ebde7d901d4e593e2d7b40ac8f7358774a66bdd4a60135fc8b206bcb"} Jul 28 01:26:22.684112 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.683393 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:22.684112 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.683639 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:22.684112 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.683703 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:24.683684676 +0000 UTC m=+56.439515170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:22.784999 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.784863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:22.785243 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.785053 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 01:26:22.785243 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.785129 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls podName:814d9efe-b4f5-491c-9135-123a3d0c1ffe nodeName:}" failed. No retries permitted until 2026-07-28 01:26:24.785108978 +0000 UTC m=+56.540939472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls") pod "cluster-samples-operator-6748489656-5rdqz" (UID: "814d9efe-b4f5-491c-9135-123a3d0c1ffe") : secret "samples-operator-tls" not found Jul 28 01:26:22.885903 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.885868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.885943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.886061 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.886079 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:24.886059645 +0000 UTC m=+56.641890146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.886099 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:24.886088091 +0000 UTC m=+56.641918582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : secret "router-metrics-certs-default" not found Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:22.886120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.886300 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:22.886347 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:22.886337 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:24.886325316 +0000 UTC m=+56.642155808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:24.019823 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.019777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" event={"ID":"6d61c0d9-918f-4899-abe2-8825abb20398","Type":"ContainerStarted","Data":"b86060bbf7b76933bbd6f87a992d11bc40e4b42caaae1e80e8ed90ad0abbe964"} Jul 28 01:26:24.038813 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.038758 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w2l2l" podStartSLOduration=2.470298053 podStartE2EDuration="4.038738222s" totalImagesPullingTime="1.568440169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:24.037482082 +0000 UTC m=+55.793312596" watchObservedRunningTime="2026-07-28 01:26:24.038738222 +0000 UTC m=+55.794568740" Jul 28 01:26:24.114063 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.114028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:24.183110 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.183076 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:24.702967 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.702913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:24.703139 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.703067 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:24.703193 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.703139 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.703121955 +0000 UTC m=+60.458952448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:24.803739 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.803694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:24.803896 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.803839 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 01:26:24.803939 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.803913 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls podName:814d9efe-b4f5-491c-9135-123a3d0c1ffe nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.803893719 +0000 UTC m=+60.559724214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls") pod "cluster-samples-operator-6748489656-5rdqz" (UID: "814d9efe-b4f5-491c-9135-123a3d0c1ffe") : secret "samples-operator-tls" not found Jul 28 01:26:24.904914 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.904882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:24.905107 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.904969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:24.905107 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:24.905010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:24.905107 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.905089 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.90506652 +0000 UTC m=+60.660897019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:24.905265 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.905122 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 01:26:24.905265 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.905133 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:24.905265 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.905162 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.90515138 +0000 UTC m=+60.660981871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : secret "router-metrics-certs-default" not found Jul 28 01:26:24.905265 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:24.905181 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.905168078 +0000 UTC m=+60.660998569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:26.603779 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:26.603681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:27.029922 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.029879 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-v56ph" event={"ID":"6227d146-0d15-456b-8d7d-566c35322667","Type":"ContainerStarted","Data":"baa3b6a63a7d47a8e81b0088474b73a86c3d1e2c14cab751c8da03b824fbe0ec"} Jul 28 01:26:27.031905 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.031877 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" event={"ID":"a44d4de1-3c6d-4a02-8175-c93e5fae68a1","Type":"ContainerStarted","Data":"5fadfb3c7bad01d39857a0ed5708d4efc2866234e1b959ebbea47a10586fe741"} Jul 28 01:26:27.038255 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.038231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/0.log" Jul 28 01:26:27.038376 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.038276 2582 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7844-c1fc-4899-b726-76074d454c92" containerID="3f0551cfbf94c2e4542737783030cf533bc64315fea23a17b80b55aae4aab045" exitCode=255 Jul 28 01:26:27.038376 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.038343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" event={"ID":"ca2d7844-c1fc-4899-b726-76074d454c92","Type":"ContainerDied","Data":"3f0551cfbf94c2e4542737783030cf533bc64315fea23a17b80b55aae4aab045"} Jul 28 01:26:27.038584 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.038564 2582 scope.go:117] "RemoveContainer" containerID="3f0551cfbf94c2e4542737783030cf533bc64315fea23a17b80b55aae4aab045" Jul 28 01:26:27.040156 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.040131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" event={"ID":"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965","Type":"ContainerStarted","Data":"c0077d71d3924c3bf41f5d0ac320e8bea1d4af981ae6884a5a9c7e174caeccdd"} Jul 28 01:26:27.042224 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.042132 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" event={"ID":"f5a01e74-8484-421d-9c8b-75f2349a377c","Type":"ContainerStarted","Data":"70132af80dc0557add3cc68bdbd03976aad6e211243397294134f4f71be6fa3a"} Jul 28 01:26:27.068297 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.068260 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-jnxqv" podStartSLOduration=2.122051755 podStartE2EDuration="7.068247608s" totalImagesPullingTime="4.946195853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:27.068046353 +0000 UTC m=+58.823876871" watchObservedRunningTime="2026-07-28 01:26:27.068247608 +0000 UTC m=+58.824078121" Jul 28 01:26:27.068409 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.068325 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-v56ph" podStartSLOduration=1.270339345 podStartE2EDuration="6.068321255s" totalImagesPullingTime="4.79798191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:27.049937753 +0000 UTC m=+58.805768268" watchObservedRunningTime="2026-07-28 01:26:27.068321255 +0000 UTC m=+58.824151769" Jul 28 01:26:27.089367 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.089326 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" podStartSLOduration=2.171700089 podStartE2EDuration="7.089313458s" totalImagesPullingTime="4.917613369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:27.088704524 +0000 UTC m=+58.844535044" watchObservedRunningTime="2026-07-28 01:26:27.089313458 +0000 UTC m=+58.845143970" Jul 28 01:26:27.106642 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.106597 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" podStartSLOduration=1.29583999 podStartE2EDuration="6.10657897s" totalImagesPullingTime="4.81073898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:27.105029543 +0000 UTC m=+58.860860055" watchObservedRunningTime="2026-07-28 01:26:27.10657897 +0000 UTC m=+58.862409484" Jul 28 01:26:27.981578 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:27.981483 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:28.018790 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.018389 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lxh66"] Jul 28 01:26:28.021315 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.021291 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.024018 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.023998 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 01:26:28.024544 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.024529 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 01:26:28.025118 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.025100 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfwwc\"" Jul 28 01:26:28.033917 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.033853 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lxh66"] Jul 28 01:26:28.048018 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.047999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:26:28.048432 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.048418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/0.log" Jul 28 01:26:28.048506 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.048450 2582 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7844-c1fc-4899-b726-76074d454c92" containerID="8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9" exitCode=255 Jul 28 01:26:28.048506 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.048476 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" event={"ID":"ca2d7844-c1fc-4899-b726-76074d454c92","Type":"ContainerDied","Data":"8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9"} Jul 28 01:26:28.048611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.048539 2582 scope.go:117] "RemoveContainer" containerID="3f0551cfbf94c2e4542737783030cf533bc64315fea23a17b80b55aae4aab045" Jul 28 01:26:28.048808 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.048792 2582 scope.go:117] "RemoveContainer" containerID="8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9" Jul 28 01:26:28.049011 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.048991 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2wjmp_openshift-console-operator(ca2d7844-c1fc-4899-b726-76074d454c92)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" podUID="ca2d7844-c1fc-4899-b726-76074d454c92" Jul 28 01:26:28.069676 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.069655 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:28.127898 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.127863 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:28.133813 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.133787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.134192 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.134172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-crio-socket\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.134290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.134220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfmv7\" (UniqueName: \"kubernetes.io/projected/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-api-access-vfmv7\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.134473 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.134450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-data-volume\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.134564 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.134523 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235441 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235547 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.235480 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 01:26:28.235547 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.235529 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.73551565 +0000 UTC m=+60.491346142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : configmap "kube-rbac-proxy" not found Jul 28 01:26:28.235547 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235532 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-crio-socket\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-crio-socket\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfmv7\" (UniqueName: \"kubernetes.io/projected/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-api-access-vfmv7\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-data-volume\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.235710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.235820 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.235810 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 01:26:28.235919 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.235871 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.735855898 +0000 UTC m=+60.491686404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : secret "insights-runtime-extractor-tls" not found Jul 28 01:26:28.236045 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.236028 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-data-volume\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.245218 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.245198 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfmv7\" (UniqueName: \"kubernetes.io/projected/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-api-access-vfmv7\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.739802 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.739773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.739987 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.739813 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:28.739987 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.739907 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:28.739987 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.739916 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 01:26:28.739987 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.739974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:36.739943049 +0000 UTC m=+68.495773540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:28.740172 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.739990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:28.740172 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.740043 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:29.740036545 +0000 UTC m=+61.495867036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : secret "insights-runtime-extractor-tls" not found Jul 28 01:26:28.740172 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.740075 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 01:26:28.740172 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.740120 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:29.740107182 +0000 UTC m=+61.495937672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : configmap "kube-rbac-proxy" not found Jul 28 01:26:28.783262 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.783226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:28.840290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.840263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:28.840400 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.840385 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 01:26:28.840445 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.840432 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls podName:814d9efe-b4f5-491c-9135-123a3d0c1ffe nodeName:}" failed. No retries permitted until 2026-07-28 01:26:36.840420384 +0000 UTC m=+68.596250878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls") pod "cluster-samples-operator-6748489656-5rdqz" (UID: "814d9efe-b4f5-491c-9135-123a3d0c1ffe") : secret "samples-operator-tls" not found Jul 28 01:26:28.868370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.868343 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:28.941231 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.941205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:28.941337 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.941268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:28.941337 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.941309 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:28.941455 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.941333 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:36.941320659 +0000 UTC m=+68.697151149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:28.941455 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.941388 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:28.941455 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.941411 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 01:26:28.941455 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.941441 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:36.941426668 +0000 UTC m=+68.697257164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:28.941590 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:28.941463 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:36.941448342 +0000 UTC m=+68.697278834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : secret "router-metrics-certs-default" not found Jul 28 01:26:28.950624 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:28.950604 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29fkx" Jul 28 01:26:29.020390 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.020360 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:29.052785 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.052762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:26:29.053094 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.053078 2582 scope.go:117] "RemoveContainer" containerID="8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9" Jul 28 01:26:29.053242 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:29.053224 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2wjmp_openshift-console-operator(ca2d7844-c1fc-4899-b726-76074d454c92)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" podUID="ca2d7844-c1fc-4899-b726-76074d454c92" Jul 28 01:26:29.079349 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.079323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:29.145150 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.145132 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:29.490846 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.490825 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:29.592856 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.592831 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:29.746872 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.746817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:29.746978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.746888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:29.746978 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:29.746969 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 01:26:29.747060 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:29.747015 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 01:26:29.747060 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:29.747039 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:31.747023693 +0000 UTC m=+63.502854184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : secret "insights-runtime-extractor-tls" not found Jul 28 01:26:29.747135 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:29.747074 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:31.747060889 +0000 UTC m=+63.502891384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : configmap "kube-rbac-proxy" not found Jul 28 01:26:29.799881 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:29.799859 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wj5md_64665e99-9108-4365-aa0f-4325cc8cbe18/dns-node-resolver/0.log" Jul 28 01:26:30.400529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:30.400509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44zng_ccede81a-d0c8-4075-8d79-0fc727895039/node-ca/0.log" Jul 28 01:26:30.853749 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:30.853715 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:30.905306 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:30.905283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:31.091054 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.091028 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-4wrpc"] Jul 28 01:26:31.093680 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.093666 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.096141 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.096124 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 01:26:31.097145 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.097127 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-44v4x\"" Jul 28 01:26:31.097232 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.097194 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 01:26:31.097294 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.097248 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 01:26:31.097294 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.097256 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 01:26:31.101132 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.101112 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-4wrpc"] Jul 28 01:26:31.158662 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.158616 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvvc\" (UniqueName: \"kubernetes.io/projected/738874fe-3628-4791-87d9-7d6dde9e94d1-kube-api-access-7hvvc\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.158755 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.158681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-key\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.158796 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.158765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-cabundle\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.205164 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.205143 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:31.259745 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.259722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvvc\" (UniqueName: \"kubernetes.io/projected/738874fe-3628-4791-87d9-7d6dde9e94d1-kube-api-access-7hvvc\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.259889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.259854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-key\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.260011 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.259996 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-cabundle\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.260522 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.260501 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-cabundle\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.262168 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.262150 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/738874fe-3628-4791-87d9-7d6dde9e94d1-signing-key\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.267277 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.267252 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvvc\" (UniqueName: \"kubernetes.io/projected/738874fe-3628-4791-87d9-7d6dde9e94d1-kube-api-access-7hvvc\") pod \"service-ca-658d7b7c78-4wrpc\" (UID: \"738874fe-3628-4791-87d9-7d6dde9e94d1\") " pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.306633 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.306611 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:31.400178 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.400155 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsp9t_5df042c8-7d55-4d9e-a957-88d9d619d288/serve-healthcheck-canary/0.log" Jul 28 01:26:31.403141 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.403124 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" Jul 28 01:26:31.468211 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.468185 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:31.468310 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.468241 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:31.468556 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.468544 2582 scope.go:117] "RemoveContainer" containerID="8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9" Jul 28 01:26:31.468709 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:31.468686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2wjmp_openshift-console-operator(ca2d7844-c1fc-4899-b726-76074d454c92)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" podUID="ca2d7844-c1fc-4899-b726-76074d454c92" Jul 28 01:26:31.522004 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.521987 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-4wrpc"] Jul 28 01:26:31.524408 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:31.524385 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738874fe_3628_4791_87d9_7d6dde9e94d1.slice/crio-8cce2686001d35b8de2a76c4f86f5a80fef7c442eedc92e71bbb652a9e5e8fe3 WatchSource:0}: Error finding container 8cce2686001d35b8de2a76c4f86f5a80fef7c442eedc92e71bbb652a9e5e8fe3: Status 404 returned error can't find the container with id 8cce2686001d35b8de2a76c4f86f5a80fef7c442eedc92e71bbb652a9e5e8fe3 Jul 28 01:26:31.764775 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.764733 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:31.764939 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:31.764820 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:31.764939 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:31.764887 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 01:26:31.765135 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:31.764941 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 01:26:31.765135 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:31.764947 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:35.764932636 +0000 UTC m=+67.520763131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : secret "insights-runtime-extractor-tls" not found Jul 28 01:26:31.765135 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:31.765015 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:35.764998283 +0000 UTC m=+67.520828783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : configmap "kube-rbac-proxy" not found Jul 28 01:26:32.042464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.042403 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:32.061964 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.061903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" event={"ID":"738874fe-3628-4791-87d9-7d6dde9e94d1","Type":"ContainerStarted","Data":"5e0f1fa09563bdd8b587613a2c2c68ab6ee242eabc49638cba44b8ae93cd36b0"} Jul 28 01:26:32.062084 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.061994 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" event={"ID":"738874fe-3628-4791-87d9-7d6dde9e94d1","Type":"ContainerStarted","Data":"8cce2686001d35b8de2a76c4f86f5a80fef7c442eedc92e71bbb652a9e5e8fe3"} Jul 28 01:26:32.084623 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.084585 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-4wrpc" podStartSLOduration=1.084571437 podStartE2EDuration="1.084571437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:32.082362828 +0000 UTC m=+63.838193353" watchObservedRunningTime="2026-07-28 01:26:32.084571437 +0000 UTC m=+63.840401949" Jul 28 01:26:32.325399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.325337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:32.390402 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:32.390371 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.132162 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.132081 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.234083 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.234029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.330282 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.330254 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.397584 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.397502 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.499560 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.499540 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.640463 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.640433 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:33.818646 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:33.818620 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:34.487944 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.487916 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:26:34.488275 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.488036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:34.490568 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.490549 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 01:26:34.490660 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.490639 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 01:26:34.498552 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:34.498536 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 01:26:34.498614 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:34.498597 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs podName:ce6f34af-1c37-47de-aa81-52b6b42a3795 nodeName:}" failed. No retries permitted until 2026-07-28 01:27:38.498584441 +0000 UTC m=+130.254414932 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs") pod "network-metrics-daemon-bncwf" (UID: "ce6f34af-1c37-47de-aa81-52b6b42a3795") : secret "metrics-daemon-secret" not found Jul 28 01:26:34.500649 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.500631 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8a4c694-c114-4bcf-8628-ae43f2540b74-original-pull-secret\") pod \"global-pull-secret-syncer-vzz62\" (UID: \"b8a4c694-c114-4bcf-8628-ae43f2540b74\") " pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:34.511774 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.511748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:34.609616 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.609594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzz62" Jul 28 01:26:34.690649 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.690617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:34.693321 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.693293 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw9zq\" (UniqueName: \"kubernetes.io/projected/bdbffc66-38e4-49b5-81c5-abca4a6e5b95-kube-api-access-rw9zq\") pod \"network-check-target-jnfwc\" (UID: \"bdbffc66-38e4-49b5-81c5-abca4a6e5b95\") " pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:34.734137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.734109 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzz62"] Jul 28 01:26:34.737177 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:34.737143 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a4c694_c114_4bcf_8628_ae43f2540b74.slice/crio-84065df0a56787d56c44b2811b2dbdd94a8936a3b7382399cdb869500406eab6 WatchSource:0}: Error finding container 84065df0a56787d56c44b2811b2dbdd94a8936a3b7382399cdb869500406eab6: Status 404 returned error can't find the container with id 84065df0a56787d56c44b2811b2dbdd94a8936a3b7382399cdb869500406eab6 Jul 28 01:26:34.818205 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.818181 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xpqm\"" Jul 28 01:26:34.826320 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.826303 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:34.839610 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.839581 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:34.947021 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:34.946994 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnfwc"] Jul 28 01:26:34.949863 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:34.949840 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbffc66_38e4_49b5_81c5_abca4a6e5b95.slice/crio-752c316c66f32254d5c8217d21bae6489e83b40a1d393cd64679ade5fb6d25fb WatchSource:0}: Error finding container 752c316c66f32254d5c8217d21bae6489e83b40a1d393cd64679ade5fb6d25fb: Status 404 returned error can't find the container with id 752c316c66f32254d5c8217d21bae6489e83b40a1d393cd64679ade5fb6d25fb Jul 28 01:26:35.071595 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.071553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnfwc" event={"ID":"bdbffc66-38e4-49b5-81c5-abca4a6e5b95","Type":"ContainerStarted","Data":"defb04dc52b7684b69f620678fe8912ca2d7a3c2fcb3dc6f0927e8e93a4c77f7"} Jul 28 01:26:35.071697 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.071627 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnfwc" event={"ID":"bdbffc66-38e4-49b5-81c5-abca4a6e5b95","Type":"ContainerStarted","Data":"752c316c66f32254d5c8217d21bae6489e83b40a1d393cd64679ade5fb6d25fb"} Jul 28 01:26:35.071697 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.071656 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:26:35.072680 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.072660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzz62" event={"ID":"b8a4c694-c114-4bcf-8628-ae43f2540b74","Type":"ContainerStarted","Data":"84065df0a56787d56c44b2811b2dbdd94a8936a3b7382399cdb869500406eab6"} Jul 28 01:26:35.101380 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.101338 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jnfwc" podStartSLOduration=66.101325494 podStartE2EDuration="1m6.101325494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:35.101262749 +0000 UTC m=+66.857093264" watchObservedRunningTime="2026-07-28 01:26:35.101325494 +0000 UTC m=+66.857156001" Jul 28 01:26:35.231482 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.231458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:35.430910 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.430823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:35.623989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.623772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:35.792689 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.792621 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:35.801366 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.801332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:35.801496 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.801420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:35.801563 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:35.801520 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 01:26:35.801614 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:35.801570 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 01:26:35.801614 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:35.801575 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:43.801558905 +0000 UTC m=+75.557389415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : secret "insights-runtime-extractor-tls" not found Jul 28 01:26:35.801614 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:35.801614 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm podName:6eb0fd49-2cef-4609-8b9c-aa0dc634fd53 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:43.801603056 +0000 UTC m=+75.557433548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lxh66" (UID: "6eb0fd49-2cef-4609-8b9c-aa0dc634fd53") : configmap "kube-rbac-proxy" not found Jul 28 01:26:35.896175 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:35.896151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:36.002668 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.002638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:26:36.002810 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.002688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:26:36.002810 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.002786 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 01:26:36.002917 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.002846 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls podName:fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea nodeName:}" failed. No retries permitted until 2026-07-28 01:27:08.002828725 +0000 UTC m=+99.758659218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls") pod "dns-default-5jgcm" (UID: "fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea") : secret "dns-default-metrics-tls" not found Jul 28 01:26:36.002917 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.002851 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 01:26:36.002917 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.002867 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749d6bd6d8-9669w: secret "image-registry-tls" not found Jul 28 01:26:36.002917 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.002904 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls podName:7842e699-aef0-42f1-b407-ffc9545421ed nodeName:}" failed. No retries permitted until 2026-07-28 01:27:08.002893416 +0000 UTC m=+99.758723907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls") pod "image-registry-749d6bd6d8-9669w" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed") : secret "image-registry-tls" not found Jul 28 01:26:36.025406 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.025379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:36.238002 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.237907 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:36.530029 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.529995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:36.810079 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.809994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:36.810478 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.810157 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:36.810478 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:36.810238 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls podName:4921e80c-64c6-48e8-a9f3-cc3ac02f93ce nodeName:}" failed. No retries permitted until 2026-07-28 01:26:52.810216809 +0000 UTC m=+84.566047302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4fgpl" (UID: "4921e80c-64c6-48e8-a9f3-cc3ac02f93ce") : secret "cluster-monitoring-operator-tls" not found Jul 28 01:26:36.826776 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.826743 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:36.911123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.911096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:36.913872 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.913852 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/814d9efe-b4f5-491c-9135-123a3d0c1ffe-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5rdqz\" (UID: \"814d9efe-b4f5-491c-9135-123a3d0c1ffe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:36.983480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.983451 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mjz9f\"" Jul 28 01:26:36.991085 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:36.991065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" Jul 28 01:26:37.012091 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.012070 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:37.012191 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.012108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:37.012191 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.012136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:37.012299 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:37.012271 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle podName:bb9613e0-54d6-4f74-be9b-971130eb0aeb nodeName:}" failed. No retries permitted until 2026-07-28 01:26:53.012246355 +0000 UTC m=+84.768076861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle") pod "router-default-85bb96f565-48h9w" (UID: "bb9613e0-54d6-4f74-be9b-971130eb0aeb") : configmap references non-existent config key: service-ca.crt Jul 28 01:26:37.012299 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:37.012289 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 01:26:37.012402 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:26:37.012340 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert podName:81c8d2d8-d0ef-413c-bed5-17213ef94469 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:53.01232372 +0000 UTC m=+84.768154233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vk8v4" (UID: "81c8d2d8-d0ef-413c-bed5-17213ef94469") : secret "networking-console-plugin-cert" not found Jul 28 01:26:37.014665 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.014650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9613e0-54d6-4f74-be9b-971130eb0aeb-metrics-certs\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:37.144170 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.144084 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz"] Jul 28 01:26:37.227519 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.227493 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:37.326066 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.325997 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:37.626909 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.626778 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:37.855045 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:37.854983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:38.023403 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:38.023327 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:38.086022 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:38.085985 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" event={"ID":"814d9efe-b4f5-491c-9135-123a3d0c1ffe","Type":"ContainerStarted","Data":"46291db9c513838747d9982697bc1b5a7e227ce7abe91b7572500f6159e15af1"} Jul 28 01:26:38.421688 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:38.421601 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:38.948159 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:38.948078 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:39.052099 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:39.052065 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:39.091732 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:39.091693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzz62" event={"ID":"b8a4c694-c114-4bcf-8628-ae43f2540b74","Type":"ContainerStarted","Data":"e4040edee2300a68aeaf609c75a6eda3c3c3f14af7b388d22959f4b01bd15007"} Jul 28 01:26:39.354782 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:39.354750 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:39.455495 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:39.455426 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:39.823464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:39.823428 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:40.030584 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.030508 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:40.096082 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.096019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" event={"ID":"814d9efe-b4f5-491c-9135-123a3d0c1ffe","Type":"ContainerStarted","Data":"f3dc49913ba3e190932b985337f16601138b3606d74be14c4d4fa4383e03f616"} Jul 28 01:26:40.096369 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.096341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" event={"ID":"814d9efe-b4f5-491c-9135-123a3d0c1ffe","Type":"ContainerStarted","Data":"4feae67a4b414d3da2294efc5aedf1f8b2a26318045c38169c402eb7484b10cb"} Jul 28 01:26:40.113985 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.113926 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5rdqz" podStartSLOduration=17.463330476 podStartE2EDuration="20.113913405s" totalImagesPullingTime="2.650582929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:40.112406257 +0000 UTC m=+71.868236770" watchObservedRunningTime="2026-07-28 01:26:40.113913405 +0000 UTC m=+71.869743937" Jul 28 01:26:40.114184 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.114164 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vzz62" podStartSLOduration=67.164915815 podStartE2EDuration="1m11.114158767s" totalImagesPullingTime="3.949242952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:39.105787708 +0000 UTC m=+70.861618221" watchObservedRunningTime="2026-07-28 01:26:40.114158767 +0000 UTC m=+71.869989279" Jul 28 01:26:40.428587 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:40.428507 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:41.107119 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:41.107084 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:41.227725 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:41.227692 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:41.420517 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:41.420458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:41.824237 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:41.824214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:42.018585 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:42.018564 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:42.626279 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:42.626256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:43.224419 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.224382 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:43.425063 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.425034 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:43.655820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.655793 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:43.800375 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.800355 2582 scope.go:117] "RemoveContainer" containerID="8a01474e2a7c4c4a90841b652a75182d3ee886e2464787bc4d5244327cc2fdb9" Jul 28 01:26:43.818887 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.818865 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:43.871792 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.871762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:43.872024 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.871997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:43.872675 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.872646 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:43.874411 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.874391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eb0fd49-2cef-4609-8b9c-aa0dc634fd53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lxh66\" (UID: \"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53\") " pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:43.932719 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.932666 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfwwc\"" Jul 28 01:26:43.941491 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:43.941474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lxh66" Jul 28 01:26:44.063293 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.063267 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lxh66"] Jul 28 01:26:44.066285 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:44.066258 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb0fd49_2cef_4609_8b9c_aa0dc634fd53.slice/crio-fe9a15afea2601e1cedb07ac92a50bc1c05800cbe50dce4f8a05403b935e5a70 WatchSource:0}: Error finding container fe9a15afea2601e1cedb07ac92a50bc1c05800cbe50dce4f8a05403b935e5a70: Status 404 returned error can't find the container with id fe9a15afea2601e1cedb07ac92a50bc1c05800cbe50dce4f8a05403b935e5a70 Jul 28 01:26:44.110326 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.110306 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:26:44.110445 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.110418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" event={"ID":"ca2d7844-c1fc-4899-b726-76074d454c92","Type":"ContainerStarted","Data":"05eee4d24932e508dffb443f2e9724a33582bb0a929c9eeaf8b41448675da19f"} Jul 28 01:26:44.110816 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.110722 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:44.111655 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.111625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lxh66" event={"ID":"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53","Type":"ContainerStarted","Data":"fe9a15afea2601e1cedb07ac92a50bc1c05800cbe50dce4f8a05403b935e5a70"} Jul 28 01:26:44.126100 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:44.126057 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" podStartSLOduration=18.354400568 podStartE2EDuration="23.12604403s" totalImagesPullingTime="4.771643462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:44.12574839 +0000 UTC m=+75.881578904" watchObservedRunningTime="2026-07-28 01:26:44.12604403 +0000 UTC m=+75.881874594" Jul 28 01:26:45.111226 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.111183 2582 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-2wjmp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": context deadline exceeded" start-of-body= Jul 28 01:26:45.111661 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.111241 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" podUID="ca2d7844-c1fc-4899-b726-76074d454c92" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": context deadline exceeded" Jul 28 01:26:45.211303 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.211270 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-2wjmp" Jul 28 01:26:45.382611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.382518 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:45.482832 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.482801 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:45.687556 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.687476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:45.864019 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.863987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:45.964843 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:45.964768 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:46.282518 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:46.282477 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:46.685631 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:46.685546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:46.735308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:46.735278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:46.885622 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:46.885590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:46.937602 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:46.937409 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:47.070142 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:47.070082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:47.472515 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:47.472481 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:47.584320 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:47.584280 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:48.882631 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:48.882593 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:48.983726 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:48.983701 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:49.131724 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:49.131659 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lxh66" event={"ID":"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53","Type":"ContainerStarted","Data":"421eb8c6df967b3e984fb2363fd6f176fc752510742ad7b06c6a6b6b885d73db"} Jul 28 01:26:51.506491 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:51.506332 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:51.686055 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:51.686015 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:51.780049 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:51.779971 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:51.879368 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:51.879334 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:51.980179 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:51.980144 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:52.849028 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:52.848989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:52.851704 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:52.851678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4921e80c-64c6-48e8-a9f3-cc3ac02f93ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4fgpl\" (UID: \"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:52.858677 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:52.858656 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xvb92\"" Jul 28 01:26:52.867508 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:52.867486 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" Jul 28 01:26:53.003481 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.003420 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl"] Jul 28 01:26:53.006198 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:53.006167 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4921e80c_64c6_48e8_a9f3_cc3ac02f93ce.slice/crio-9d1b00123761290893f1c9181bcf0e5ff9e205dbda898f57615e1265868f0e1c WatchSource:0}: Error finding container 9d1b00123761290893f1c9181bcf0e5ff9e205dbda898f57615e1265868f0e1c: Status 404 returned error can't find the container with id 9d1b00123761290893f1c9181bcf0e5ff9e205dbda898f57615e1265868f0e1c Jul 28 01:26:53.050330 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.050294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:53.050574 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.050545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:53.051205 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.051185 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9613e0-54d6-4f74-be9b-971130eb0aeb-service-ca-bundle\") pod \"router-default-85bb96f565-48h9w\" (UID: \"bb9613e0-54d6-4f74-be9b-971130eb0aeb\") " pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:53.053108 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.053085 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81c8d2d8-d0ef-413c-bed5-17213ef94469-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vk8v4\" (UID: \"81c8d2d8-d0ef-413c-bed5-17213ef94469\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:53.146966 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.146886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lxh66" event={"ID":"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53","Type":"ContainerStarted","Data":"a7b4836caafc2ba98481cd6d6538058dd77014119658f3e6729e89fc9d381652"} Jul 28 01:26:53.148154 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.148131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" event={"ID":"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce","Type":"ContainerStarted","Data":"9d1b00123761290893f1c9181bcf0e5ff9e205dbda898f57615e1265868f0e1c"} Jul 28 01:26:53.294421 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.294391 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j5ff5\"" Jul 28 01:26:53.302528 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.302508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:53.308056 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.308026 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4qs98\"" Jul 28 01:26:53.316067 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.316009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" Jul 28 01:26:53.456217 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.456189 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bb96f565-48h9w"] Jul 28 01:26:53.458585 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:53.458564 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9613e0_54d6_4f74_be9b_971130eb0aeb.slice/crio-c568e8b597e055fce4b336df92ebd51640f2d70deed92945330c4a0f779c3930 WatchSource:0}: Error finding container c568e8b597e055fce4b336df92ebd51640f2d70deed92945330c4a0f779c3930: Status 404 returned error can't find the container with id c568e8b597e055fce4b336df92ebd51640f2d70deed92945330c4a0f779c3930 Jul 28 01:26:53.472608 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.472268 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4"] Jul 28 01:26:53.477814 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:26:53.477786 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c8d2d8_d0ef_413c_bed5_17213ef94469.slice/crio-676a6e05a199bf71abc6e49efc67dabce57a6a912c13eaaa2d6a45a350ae4d20 WatchSource:0}: Error finding container 676a6e05a199bf71abc6e49efc67dabce57a6a912c13eaaa2d6a45a350ae4d20: Status 404 returned error can't find the container with id 676a6e05a199bf71abc6e49efc67dabce57a6a912c13eaaa2d6a45a350ae4d20 Jul 28 01:26:53.893469 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.893428 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:53.955099 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:53.955071 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:54.154268 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.154189 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" event={"ID":"81c8d2d8-d0ef-413c-bed5-17213ef94469","Type":"ContainerStarted","Data":"676a6e05a199bf71abc6e49efc67dabce57a6a912c13eaaa2d6a45a350ae4d20"} Jul 28 01:26:54.156056 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.156025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bb96f565-48h9w" event={"ID":"bb9613e0-54d6-4f74-be9b-971130eb0aeb","Type":"ContainerStarted","Data":"80a28faa3ac55751d2ffc1a4a686b5d1066df009245dca6975a65fc8867beeaf"} Jul 28 01:26:54.156205 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.156072 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bb96f565-48h9w" event={"ID":"bb9613e0-54d6-4f74-be9b-971130eb0aeb","Type":"ContainerStarted","Data":"c568e8b597e055fce4b336df92ebd51640f2d70deed92945330c4a0f779c3930"} Jul 28 01:26:54.176137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.176082 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85bb96f565-48h9w" podStartSLOduration=33.176065878 podStartE2EDuration="33.176065878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:54.174582065 +0000 UTC m=+85.930412592" watchObservedRunningTime="2026-07-28 01:26:54.176065878 +0000 UTC m=+85.931896394" Jul 28 01:26:54.303434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.303405 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:54.306155 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:54.306129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:55.160023 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:55.159989 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:55.161220 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:55.161193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85bb96f565-48h9w" Jul 28 01:26:56.203409 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:56.203376 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:56.304140 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:56.304096 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:57.780903 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:57.780870 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:57.886529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:57.886420 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:57.980749 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:57.980697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:58.100459 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.100430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:58.173881 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.173810 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lxh66" event={"ID":"6eb0fd49-2cef-4609-8b9c-aa0dc634fd53","Type":"ContainerStarted","Data":"3ed7a7f1810b5f0f05009d803753fd65ac41e161225b7991874a46782b9a9448"} Jul 28 01:26:58.175487 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.175441 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" event={"ID":"4921e80c-64c6-48e8-a9f3-cc3ac02f93ce","Type":"ContainerStarted","Data":"2c65cf425e219f02de1a9a1aabaa14dfb89320d33803877f349b20d1636212d7"} Jul 28 01:26:58.177030 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.177007 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" event={"ID":"81c8d2d8-d0ef-413c-bed5-17213ef94469","Type":"ContainerStarted","Data":"b66d47d41dcb5172c0aa3f2f3dc12428e2a91c12a268779f68bf0913b4abb276"} Jul 28 01:26:58.183380 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.183355 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:58.198256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.198211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lxh66" podStartSLOduration=17.801671466 podStartE2EDuration="31.198194708s" totalImagesPullingTime="13.396523242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:58.196118033 +0000 UTC m=+89.951948546" watchObservedRunningTime="2026-07-28 01:26:58.198194708 +0000 UTC m=+89.954025202" Jul 28 01:26:58.227651 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.227610 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vk8v4" podStartSLOduration=33.123973049 podStartE2EDuration="37.227594275s" totalImagesPullingTime="4.103621226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:58.227164003 +0000 UTC m=+89.982994516" watchObservedRunningTime="2026-07-28 01:26:58.227594275 +0000 UTC m=+89.983424789" Jul 28 01:26:58.228200 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.228170 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4fgpl" podStartSLOduration=33.654381687 podStartE2EDuration="38.228163437s" totalImagesPullingTime="4.57378175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:58.211574884 +0000 UTC m=+89.967405397" watchObservedRunningTime="2026-07-28 01:26:58.228163437 +0000 UTC m=+89.983993951" Jul 28 01:26:58.330891 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.330862 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:58.383188 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.383162 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:26:58.670385 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:26:58.670357 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:03.276978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:03.276931 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:03.332294 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:03.332259 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:04.005124 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:04.005098 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:04.062642 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:04.062612 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:04.697299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:04.697263 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:04.757612 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:04.757580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:05.919347 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:05.919310 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:05.973859 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:05.973828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:06.079418 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:06.079396 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jnfwc" Jul 28 01:27:08.059325 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.059294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:27:08.059325 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.059328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:08.061656 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.061632 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea-metrics-tls\") pod \"dns-default-5jgcm\" (UID: \"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea\") " pod="openshift-dns/dns-default-5jgcm" Jul 28 01:27:08.061656 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.061645 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"image-registry-749d6bd6d8-9669w\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:08.264361 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.264337 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tgrjr\"" Jul 28 01:27:08.272537 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.272512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:08.280826 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.280808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtm4s\"" Jul 28 01:27:08.289482 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.289459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5jgcm" Jul 28 01:27:08.417186 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.417151 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:27:08.422002 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:27:08.421972 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7842e699_aef0_42f1_b407_ffc9545421ed.slice/crio-c9ad63f12c0ff5ea9bc03f4662d1b026229f6c96d588ab3bcd3e3362f5d913a9 WatchSource:0}: Error finding container c9ad63f12c0ff5ea9bc03f4662d1b026229f6c96d588ab3bcd3e3362f5d913a9: Status 404 returned error can't find the container with id c9ad63f12c0ff5ea9bc03f4662d1b026229f6c96d588ab3bcd3e3362f5d913a9 Jul 28 01:27:08.432137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:08.432117 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5jgcm"] Jul 28 01:27:08.434318 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:27:08.434289 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0e634c_36ba_4d3c_93b3_374ffd3fb4ea.slice/crio-6ca501f88bf91975276eb1c67d9285b7c2d1f42dc558792d4ea361dc718e19e1 WatchSource:0}: Error finding container 6ca501f88bf91975276eb1c67d9285b7c2d1f42dc558792d4ea361dc718e19e1: Status 404 returned error can't find the container with id 6ca501f88bf91975276eb1c67d9285b7c2d1f42dc558792d4ea361dc718e19e1 Jul 28 01:27:09.215645 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:09.215596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" event={"ID":"7842e699-aef0-42f1-b407-ffc9545421ed","Type":"ContainerStarted","Data":"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2"} Jul 28 01:27:09.216123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:09.215660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" event={"ID":"7842e699-aef0-42f1-b407-ffc9545421ed","Type":"ContainerStarted","Data":"c9ad63f12c0ff5ea9bc03f4662d1b026229f6c96d588ab3bcd3e3362f5d913a9"} Jul 28 01:27:09.216123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:09.215689 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:09.217163 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:09.217133 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jgcm" event={"ID":"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea","Type":"ContainerStarted","Data":"6ca501f88bf91975276eb1c67d9285b7c2d1f42dc558792d4ea361dc718e19e1"} Jul 28 01:27:09.242161 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:09.242118 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" podStartSLOduration=100.24210185 podStartE2EDuration="1m40.24210185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:09.24039505 +0000 UTC m=+100.996225564" watchObservedRunningTime="2026-07-28 01:27:09.24210185 +0000 UTC m=+100.997932363" Jul 28 01:27:10.222370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:10.222297 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jgcm" event={"ID":"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea","Type":"ContainerStarted","Data":"61987ece25a07bf1607b82efee135fc592328bf124badcc6a8dad662eeaebc67"} Jul 28 01:27:10.222370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:10.222361 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jgcm" event={"ID":"fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea","Type":"ContainerStarted","Data":"742688d4b98a03578e277b646cab6b7d5fa1a3a8d7a73f150ffc047875b3d73e"} Jul 28 01:27:10.240642 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:10.240594 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5jgcm" podStartSLOduration=64.844864106 podStartE2EDuration="1m6.240578609s" totalImagesPullingTime="1.395714503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:10.239483317 +0000 UTC m=+101.995313827" watchObservedRunningTime="2026-07-28 01:27:10.240578609 +0000 UTC m=+101.996409125" Jul 28 01:27:11.226047 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:11.226019 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5jgcm" Jul 28 01:27:12.149083 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:12.149026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:12.224401 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:12.224369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:12.288696 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:12.288675 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:12.391862 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:12.391833 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:12.448333 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:12.448261 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:13.540718 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:13.540683 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:13.641422 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:13.641396 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:13.805167 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:13.805095 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:27:13.899432 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:13.899399 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:13.963714 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:13.963634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:14.107534 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:14.107462 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:14.212060 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:14.212030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:14.310715 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:14.310684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:14.962196 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:14.962165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:15.063246 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:15.063216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:15.125143 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:15.125117 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:17.803785 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:17.803738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:17.905348 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:17.905320 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:18.897480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:18.897444 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:18.947754 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:18.947724 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:21.231758 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:21.231731 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5jgcm" Jul 28 01:27:22.054665 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:22.054636 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:23.810356 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:23.810327 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:24.261459 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.261420 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:24.485621 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.485567 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:24.537505 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.537431 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-frfzj"] Jul 28 01:27:24.541053 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.541032 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.543668 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.543643 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-469rd\"" Jul 28 01:27:24.543785 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.543652 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 01:27:24.544635 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.544614 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 01:27:24.544744 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.544671 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 01:27:24.544744 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.544624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 01:27:24.569114 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-metrics-client-ca\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569225 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-root\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569225 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-textfile\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569326 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-sys\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569326 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-tls\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569421 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569350 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569421 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569421 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4csk6\" (UniqueName: \"kubernetes.io/projected/e878053a-8c7b-4523-988b-153d2ec216b0-kube-api-access-4csk6\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.569571 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.569433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-wtmp\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.575678 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.575650 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:24.670169 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-root\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-textfile\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-sys\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-tls\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670270 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-root\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4csk6\" (UniqueName: \"kubernetes.io/projected/e878053a-8c7b-4523-988b-153d2ec216b0-kube-api-access-4csk6\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-wtmp\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670434 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-metrics-client-ca\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670646 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670523 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-textfile\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670646 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-wtmp\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670746 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e878053a-8c7b-4523-988b-153d2ec216b0-sys\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670895 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670873 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-metrics-client-ca\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.670986 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.670873 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.672536 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.672507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.672655 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.672637 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e878053a-8c7b-4523-988b-153d2ec216b0-node-exporter-tls\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.678118 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.678092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:24.678904 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.678884 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4csk6\" (UniqueName: \"kubernetes.io/projected/e878053a-8c7b-4523-988b-153d2ec216b0-kube-api-access-4csk6\") pod \"node-exporter-frfzj\" (UID: \"e878053a-8c7b-4523-988b-153d2ec216b0\") " pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.778984 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.778924 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:24.851798 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.851743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frfzj" Jul 28 01:27:24.868358 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:27:24.868330 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode878053a_8c7b_4523_988b_153d2ec216b0.slice/crio-fbf6e531493622e73f84568f9f34f3d631f1726fa1f853ef334f46777898a977 WatchSource:0}: Error finding container fbf6e531493622e73f84568f9f34f3d631f1726fa1f853ef334f46777898a977: Status 404 returned error can't find the container with id fbf6e531493622e73f84568f9f34f3d631f1726fa1f853ef334f46777898a977 Jul 28 01:27:24.879374 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:24.879342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.000276 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.000242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.133187 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.133123 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.239117 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.239089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.276140 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.276111 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frfzj" event={"ID":"e878053a-8c7b-4523-988b-153d2ec216b0","Type":"ContainerStarted","Data":"fbf6e531493622e73f84568f9f34f3d631f1726fa1f853ef334f46777898a977"} Jul 28 01:27:25.332917 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.332867 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.494676 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.494639 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.570313 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.570283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:25.912579 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:25.912503 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:26.280677 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:26.280654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frfzj" event={"ID":"e878053a-8c7b-4523-988b-153d2ec216b0","Type":"ContainerStarted","Data":"b63e3242d5b58fbed81aab0c6c32cf6d5da06503497fb2efdaff2b35fdab1a19"} Jul 28 01:27:27.285480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:27.285448 2582 generic.go:356] "Generic (PLEG): container finished" podID="e878053a-8c7b-4523-988b-153d2ec216b0" containerID="b63e3242d5b58fbed81aab0c6c32cf6d5da06503497fb2efdaff2b35fdab1a19" exitCode=0 Jul 28 01:27:27.285871 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:27.285532 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frfzj" event={"ID":"e878053a-8c7b-4523-988b-153d2ec216b0","Type":"ContainerDied","Data":"b63e3242d5b58fbed81aab0c6c32cf6d5da06503497fb2efdaff2b35fdab1a19"} Jul 28 01:27:27.473578 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:27.473536 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:27.550406 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:27.550343 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:27.683173 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:27.683141 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:28.195665 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:28.195640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:28.290530 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:28.290498 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frfzj" event={"ID":"e878053a-8c7b-4523-988b-153d2ec216b0","Type":"ContainerStarted","Data":"d582d76fc5560d0f17d50f50220c14d2e437cd8ad2e5e3574ffb7b1ecac8a11f"} Jul 28 01:27:28.290832 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:28.290586 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frfzj" event={"ID":"e878053a-8c7b-4523-988b-153d2ec216b0","Type":"ContainerStarted","Data":"c234be11877ac0e127320f5bc419cb1c86078fe0d755129912332f2e2d56bc83"} Jul 28 01:27:28.309868 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:28.309820 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-frfzj" podStartSLOduration=2.920687186 podStartE2EDuration="4.309807432s" totalImagesPullingTime="1.294840057s" totalInitContainerRuntime="94.280189ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:28.307981551 +0000 UTC m=+120.063812065" watchObservedRunningTime="2026-07-28 01:27:28.309807432 +0000 UTC m=+120.065637944" Jul 28 01:27:29.341886 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:29.341850 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:29.438292 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:29.438257 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:29.535749 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:29.535722 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:29.636591 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:29.636500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:30.354794 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:30.354740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:30.428384 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:30.428344 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:30.769555 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:30.769524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:33.309675 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:33.309648 2582 generic.go:356] "Generic (PLEG): container finished" podID="a44d4de1-3c6d-4a02-8175-c93e5fae68a1" containerID="5fadfb3c7bad01d39857a0ed5708d4efc2866234e1b959ebbea47a10586fe741" exitCode=0 Jul 28 01:27:33.310007 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:33.309699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" event={"ID":"a44d4de1-3c6d-4a02-8175-c93e5fae68a1","Type":"ContainerDied","Data":"5fadfb3c7bad01d39857a0ed5708d4efc2866234e1b959ebbea47a10586fe741"} Jul 28 01:27:33.310007 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:33.309939 2582 scope.go:117] "RemoveContainer" containerID="5fadfb3c7bad01d39857a0ed5708d4efc2866234e1b959ebbea47a10586fe741" Jul 28 01:27:34.315634 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:34.315581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gf7r2" event={"ID":"a44d4de1-3c6d-4a02-8175-c93e5fae68a1","Type":"ContainerStarted","Data":"9768a9454cb3fc48fda137c3a6041a6fcd918aab34265d3580944ffcf60f98ee"} Jul 28 01:27:37.328672 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.328600 2582 generic.go:356] "Generic (PLEG): container finished" podID="6227d146-0d15-456b-8d7d-566c35322667" containerID="baa3b6a63a7d47a8e81b0088474b73a86c3d1e2c14cab751c8da03b824fbe0ec" exitCode=0 Jul 28 01:27:37.328672 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.328636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-v56ph" event={"ID":"6227d146-0d15-456b-8d7d-566c35322667","Type":"ContainerDied","Data":"baa3b6a63a7d47a8e81b0088474b73a86c3d1e2c14cab751c8da03b824fbe0ec"} Jul 28 01:27:37.329061 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.328940 2582 scope.go:117] "RemoveContainer" containerID="baa3b6a63a7d47a8e81b0088474b73a86c3d1e2c14cab751c8da03b824fbe0ec" Jul 28 01:27:37.337014 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.336993 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:27:37.341064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.341047 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.343430 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343404 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 01:27:37.343538 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343466 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 01:27:37.343538 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343486 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 01:27:37.343538 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343528 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 01:27:37.343707 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343555 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 01:27:37.343835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.343814 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 01:27:37.344616 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.344591 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 01:27:37.344711 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.344650 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ttt4j\"" Jul 28 01:27:37.348301 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.348280 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 01:27:37.351845 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.351826 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:27:37.365773 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.365730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366002 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.365981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366186 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.366164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.366195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.366257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.366280 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.366471 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.366334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqws2\" (UniqueName: \"kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467413 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqws2\" (UniqueName: \"kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467765 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.467765 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.467655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.468318 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.468291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.468451 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.468330 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.468545 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.468522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.468628 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.468543 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.470052 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.470026 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.470256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.470237 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.475608 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.475587 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqws2\" (UniqueName: \"kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2\") pod \"console-65f4c8878d-5b7kb\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.670777 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.670724 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:37.803337 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.803303 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:27:37.927058 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.926994 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb96f565-48h9w_bb9613e0-54d6-4f74-be9b-971130eb0aeb/router/0.log" Jul 28 01:27:37.946197 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:37.946171 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsp9t_5df042c8-7d55-4d9e-a957-88d9d619d288/serve-healthcheck-canary/0.log" Jul 28 01:27:38.335731 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.335693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-v56ph" event={"ID":"6227d146-0d15-456b-8d7d-566c35322667","Type":"ContainerStarted","Data":"d741293a1180f70b00de6889ffdf9fbb83f086d7a702f5f4f9e2957097768dd4"} Jul 28 01:27:38.337465 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.337431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4c8878d-5b7kb" event={"ID":"36f931c3-2e87-47b1-b6fa-b78dd3232506","Type":"ContainerStarted","Data":"9cd1a925d6b975e3eca2a7ad15625a7a01f72b95e94a7c2f7bf2d6298c5e74f4"} Jul 28 01:27:38.579259 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.579219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:27:38.581980 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.581927 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f34af-1c37-47de-aa81-52b6b42a3795-metrics-certs\") pod \"network-metrics-daemon-bncwf\" (UID: \"ce6f34af-1c37-47de-aa81-52b6b42a3795\") " pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:27:38.723277 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.723027 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptgdn\"" Jul 28 01:27:38.731034 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.731008 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bncwf" Jul 28 01:27:38.824119 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.823884 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" podUID="7842e699-aef0-42f1-b407-ffc9545421ed" containerName="registry" containerID="cri-o://222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2" gracePeriod=30 Jul 28 01:27:38.908452 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:38.908387 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bncwf"] Jul 28 01:27:38.911583 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:27:38.911556 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6f34af_1c37_47de_aa81_52b6b42a3795.slice/crio-3c199443c7cb70f7f1b09234d350026538aca1081e59ff663426bd21295ddbfd WatchSource:0}: Error finding container 3c199443c7cb70f7f1b09234d350026538aca1081e59ff663426bd21295ddbfd: Status 404 returned error can't find the container with id 3c199443c7cb70f7f1b09234d350026538aca1081e59ff663426bd21295ddbfd Jul 28 01:27:39.085024 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.084995 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:39.182680 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182650 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.182829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182701 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhg2v\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.182829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182723 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.182829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182749 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.182829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182781 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.182829 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182807 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.183097 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182851 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.183097 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.182889 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration\") pod \"7842e699-aef0-42f1-b407-ffc9545421ed\" (UID: \"7842e699-aef0-42f1-b407-ffc9545421ed\") " Jul 28 01:27:39.184523 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.183916 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:27:39.184523 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.184424 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:27:39.185643 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.185611 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:27:39.186389 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.186001 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:27:39.186389 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.186046 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:27:39.186389 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.186067 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v" (OuterVolumeSpecName: "kube-api-access-dhg2v") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "kube-api-access-dhg2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:27:39.191173 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.190888 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:27:39.195634 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.195573 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7842e699-aef0-42f1-b407-ffc9545421ed" (UID: "7842e699-aef0-42f1-b407-ffc9545421ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:27:39.284543 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284471 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-registry-certificates\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284543 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284503 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhg2v\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-kube-api-access-dhg2v\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284543 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284518 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-bound-sa-token\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284543 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284532 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7842e699-aef0-42f1-b407-ffc9545421ed-registry-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284543 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284545 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-installation-pull-secrets\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284845 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284558 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7842e699-aef0-42f1-b407-ffc9545421ed-trusted-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284845 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284571 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7842e699-aef0-42f1-b407-ffc9545421ed-ca-trust-extracted\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.284845 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.284586 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7842e699-aef0-42f1-b407-ffc9545421ed-image-registry-private-configuration\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:27:39.345399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.344632 2582 generic.go:356] "Generic (PLEG): container finished" podID="7842e699-aef0-42f1-b407-ffc9545421ed" containerID="222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2" exitCode=0 Jul 28 01:27:39.345399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.344723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" event={"ID":"7842e699-aef0-42f1-b407-ffc9545421ed","Type":"ContainerDied","Data":"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2"} Jul 28 01:27:39.345399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.344804 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" event={"ID":"7842e699-aef0-42f1-b407-ffc9545421ed","Type":"ContainerDied","Data":"c9ad63f12c0ff5ea9bc03f4662d1b026229f6c96d588ab3bcd3e3362f5d913a9"} Jul 28 01:27:39.345399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.344833 2582 scope.go:117] "RemoveContainer" containerID="222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2" Jul 28 01:27:39.345399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.345008 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749d6bd6d8-9669w" Jul 28 01:27:39.346968 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.346903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bncwf" event={"ID":"ce6f34af-1c37-47de-aa81-52b6b42a3795","Type":"ContainerStarted","Data":"3c199443c7cb70f7f1b09234d350026538aca1081e59ff663426bd21295ddbfd"} Jul 28 01:27:39.355412 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.355341 2582 scope.go:117] "RemoveContainer" containerID="222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2" Jul 28 01:27:39.355755 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:27:39.355716 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2\": container with ID starting with 222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2 not found: ID does not exist" containerID="222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2" Jul 28 01:27:39.355857 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.355756 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2"} err="failed to get container status \"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2\": rpc error: code = NotFound desc = could not find container \"222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2\": container with ID starting with 222243c2e1a4a0c736fd991e82c3f1313a7abc8c701e06b6942e180d55063fe2 not found: ID does not exist" Jul 28 01:27:39.370652 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.370629 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:27:39.374089 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:39.374067 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-749d6bd6d8-9669w"] Jul 28 01:27:40.804364 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:40.804336 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7842e699-aef0-42f1-b407-ffc9545421ed" path="/var/lib/kubelet/pods/7842e699-aef0-42f1-b407-ffc9545421ed/volumes" Jul 28 01:27:41.196509 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.196450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:41.269903 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.269876 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:41.357306 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.357284 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bncwf" event={"ID":"ce6f34af-1c37-47de-aa81-52b6b42a3795","Type":"ContainerStarted","Data":"fe54dc4f5c76aa1fcdbb96544ac8846cf173d642b3e25d5d0d052b1983390d03"} Jul 28 01:27:41.357409 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.357339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bncwf" event={"ID":"ce6f34af-1c37-47de-aa81-52b6b42a3795","Type":"ContainerStarted","Data":"96eabac51202de5ed299afd853ca87ce0392cb30064616b9f638a81f9bea4f3a"} Jul 28 01:27:41.358792 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.358770 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4c8878d-5b7kb" event={"ID":"36f931c3-2e87-47b1-b6fa-b78dd3232506","Type":"ContainerStarted","Data":"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5"} Jul 28 01:27:41.374514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.374475 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bncwf" podStartSLOduration=130.472371935 podStartE2EDuration="2m12.374462754s" totalImagesPullingTime="1.902090819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:41.373232903 +0000 UTC m=+133.129063416" watchObservedRunningTime="2026-07-28 01:27:41.374462754 +0000 UTC m=+133.130293266" Jul 28 01:27:41.390796 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.390755 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f4c8878d-5b7kb" podStartSLOduration=1.361244519 podStartE2EDuration="4.390742326s" totalImagesPullingTime="3.029497807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:41.39015661 +0000 UTC m=+133.145987122" watchObservedRunningTime="2026-07-28 01:27:41.390742326 +0000 UTC m=+133.146572862" Jul 28 01:27:41.474988 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.474916 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:41.536820 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:41.536796 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:42.364760 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:42.364724 2582 generic.go:356] "Generic (PLEG): container finished" podID="8eb31a5b-4d6c-48ef-ac20-ce0d12b58965" containerID="c0077d71d3924c3bf41f5d0ac320e8bea1d4af981ae6884a5a9c7e174caeccdd" exitCode=0 Jul 28 01:27:42.365127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:42.364801 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" event={"ID":"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965","Type":"ContainerDied","Data":"c0077d71d3924c3bf41f5d0ac320e8bea1d4af981ae6884a5a9c7e174caeccdd"} Jul 28 01:27:42.365360 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:42.365340 2582 scope.go:117] "RemoveContainer" containerID="c0077d71d3924c3bf41f5d0ac320e8bea1d4af981ae6884a5a9c7e174caeccdd" Jul 28 01:27:43.370227 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:43.370191 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z9568" event={"ID":"8eb31a5b-4d6c-48ef-ac20-ce0d12b58965","Type":"ContainerStarted","Data":"13ee218cac2ab87f9c2e30631420597f4b416cb784f1b189093e09d5aaf1161d"} Jul 28 01:27:47.671458 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:47.671423 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:47.671941 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:47.671488 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:47.678003 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:47.677973 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:48.394684 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:48.394656 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:27:48.533701 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:48.533662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:48.586296 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:48.586257 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:48.640446 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:48.640409 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:49.496728 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:49.496697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:49.597763 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:49.597726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:49.654561 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:49.654523 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:56.203704 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:56.203670 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:27:56.303749 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:27:56.303715 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:40.602421 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:40.602381 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:40.703695 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:40.703663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:45.586105 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.586076 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:28:45.586464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.586399 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7842e699-aef0-42f1-b407-ffc9545421ed" containerName="registry" Jul 28 01:28:45.586464 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.586419 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7842e699-aef0-42f1-b407-ffc9545421ed" containerName="registry" Jul 28 01:28:45.586546 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.586473 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7842e699-aef0-42f1-b407-ffc9545421ed" containerName="registry" Jul 28 01:28:45.588937 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.588911 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.603657 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.603635 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:28:45.638050 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.638016 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:45.695013 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.694987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:45.750000 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.749974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnkz5\" (UniqueName: \"kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750098 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750005 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750098 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750098 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750098 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750257 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.750257 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.750182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnkz5\" (UniqueName: \"kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.851514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.851383 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.852179 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.852146 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.852179 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.852162 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.852288 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.852187 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.852350 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.852327 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.853846 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.853820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.853946 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.853906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.858935 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.858915 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnkz5\" (UniqueName: \"kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5\") pod \"console-54794bb77b-n6s8l\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:45.899461 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:45.899440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:46.027648 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:46.027621 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:28:46.031159 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:28:46.031120 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078e07c6_92b6_4b61_af47_c8a7dab26f83.slice/crio-1b9cd009698461c5e2e41e3cc9b0befea2657395b060d97979962c871bfa15cc WatchSource:0}: Error finding container 1b9cd009698461c5e2e41e3cc9b0befea2657395b060d97979962c871bfa15cc: Status 404 returned error can't find the container with id 1b9cd009698461c5e2e41e3cc9b0befea2657395b060d97979962c871bfa15cc Jul 28 01:28:46.600695 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:46.600661 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54794bb77b-n6s8l" event={"ID":"078e07c6-92b6-4b61-af47-c8a7dab26f83","Type":"ContainerStarted","Data":"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063"} Jul 28 01:28:46.601091 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:46.600716 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54794bb77b-n6s8l" event={"ID":"078e07c6-92b6-4b61-af47-c8a7dab26f83","Type":"ContainerStarted","Data":"1b9cd009698461c5e2e41e3cc9b0befea2657395b060d97979962c871bfa15cc"} Jul 28 01:28:46.618159 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:46.618113 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54794bb77b-n6s8l" podStartSLOduration=1.618099008 podStartE2EDuration="1.618099008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:28:46.616746713 +0000 UTC m=+198.372577229" watchObservedRunningTime="2026-07-28 01:28:46.618099008 +0000 UTC m=+198.373929521" Jul 28 01:28:52.655550 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:52.655512 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:52.707231 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:52.707191 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:55.900392 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:55.900361 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:55.900773 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:55.900434 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:55.905278 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:55.905255 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:56.208571 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.208496 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:56.309294 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.309269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:56.640433 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.640409 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:28:56.689300 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.689274 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:28:56.783385 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.783349 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:56.884078 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.884050 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:28:56.943121 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:28:56.943054 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:29:02.104235 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:02.104201 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:29:07.957485 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:07.957447 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:29:21.709624 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.709564 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f4c8878d-5b7kb" podUID="36f931c3-2e87-47b1-b6fa-b78dd3232506" containerName="console" containerID="cri-o://22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5" gracePeriod=15 Jul 28 01:29:21.944706 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.944681 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:29:21.985918 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.985863 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.985918 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.985903 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986109 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.985919 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986109 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.985980 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986109 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986067 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986316 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986116 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqws2\" (UniqueName: \"kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986316 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986141 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert\") pod \"36f931c3-2e87-47b1-b6fa-b78dd3232506\" (UID: \"36f931c3-2e87-47b1-b6fa-b78dd3232506\") " Jul 28 01:29:21.986426 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986333 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:29:21.986426 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986399 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:29:21.986529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986453 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca" (OuterVolumeSpecName: "service-ca") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:29:21.986529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.986469 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config" (OuterVolumeSpecName: "console-config") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:29:21.988214 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.988189 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:29:21.988315 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.988245 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:29:21.988358 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:21.988327 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2" (OuterVolumeSpecName: "kube-api-access-jqws2") pod "36f931c3-2e87-47b1-b6fa-b78dd3232506" (UID: "36f931c3-2e87-47b1-b6fa-b78dd3232506"). InnerVolumeSpecName "kube-api-access-jqws2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:29:22.086978 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.086940 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.086979 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.086994 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqws2\" (UniqueName: \"kubernetes.io/projected/36f931c3-2e87-47b1-b6fa-b78dd3232506-kube-api-access-jqws2\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.087005 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-serving-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.087014 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-trusted-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.087022 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36f931c3-2e87-47b1-b6fa-b78dd3232506-oauth-serving-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.087065 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.087030 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36f931c3-2e87-47b1-b6fa-b78dd3232506-console-oauth-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:29:22.735205 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.735174 2582 generic.go:356] "Generic (PLEG): container finished" podID="36f931c3-2e87-47b1-b6fa-b78dd3232506" containerID="22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5" exitCode=0 Jul 28 01:29:22.735552 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.735209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4c8878d-5b7kb" event={"ID":"36f931c3-2e87-47b1-b6fa-b78dd3232506","Type":"ContainerDied","Data":"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5"} Jul 28 01:29:22.735552 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.735219 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4c8878d-5b7kb" Jul 28 01:29:22.735552 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.735243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4c8878d-5b7kb" event={"ID":"36f931c3-2e87-47b1-b6fa-b78dd3232506","Type":"ContainerDied","Data":"9cd1a925d6b975e3eca2a7ad15625a7a01f72b95e94a7c2f7bf2d6298c5e74f4"} Jul 28 01:29:22.735552 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.735263 2582 scope.go:117] "RemoveContainer" containerID="22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5" Jul 28 01:29:22.744144 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.744127 2582 scope.go:117] "RemoveContainer" containerID="22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5" Jul 28 01:29:22.744376 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:29:22.744360 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5\": container with ID starting with 22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5 not found: ID does not exist" containerID="22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5" Jul 28 01:29:22.744412 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.744384 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5"} err="failed to get container status \"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5\": rpc error: code = NotFound desc = could not find container \"22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5\": container with ID starting with 22066dd1d8e6a0faddd4fca94e80b5821b3f9df0493fe2d5397d0f1b2e86e5a5 not found: ID does not exist" Jul 28 01:29:22.756159 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.756129 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:29:22.760545 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.760525 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f4c8878d-5b7kb"] Jul 28 01:29:22.803587 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:29:22.803566 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36f931c3-2e87-47b1-b6fa-b78dd3232506" path="/var/lib/kubelet/pods/36f931c3-2e87-47b1-b6fa-b78dd3232506/volumes" Jul 28 01:30:21.055401 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:21.055367 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:25.172002 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:25.171947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:25.224068 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:25.224035 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:25.533115 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:25.533079 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:25.632940 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:25.632908 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:25.685529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:25.685502 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:26.428467 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.428436 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf"] Jul 28 01:30:26.428895 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.428732 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36f931c3-2e87-47b1-b6fa-b78dd3232506" containerName="console" Jul 28 01:30:26.428895 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.428744 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36f931c3-2e87-47b1-b6fa-b78dd3232506" containerName="console" Jul 28 01:30:26.428895 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.428798 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36f931c3-2e87-47b1-b6fa-b78dd3232506" containerName="console" Jul 28 01:30:26.431715 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.431695 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.434253 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.434230 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 01:30:26.434381 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.434304 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 01:30:26.434381 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.434326 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ftm4d\"" Jul 28 01:30:26.440280 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.440255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf"] Jul 28 01:30:26.530227 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.530193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.530227 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.530229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.530437 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.530255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx6jh\" (UniqueName: \"kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.631486 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.631440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.631486 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.631489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.631637 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.631516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx6jh\" (UniqueName: \"kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.631835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.631814 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.631882 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.631838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.639440 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.639408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx6jh\" (UniqueName: \"kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.741264 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.741233 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:26.869530 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.869506 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf"] Jul 28 01:30:26.871749 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:30:26.871719 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402c321e_742e_4df2_a538_24431add2b2d.slice/crio-635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d WatchSource:0}: Error finding container 635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d: Status 404 returned error can't find the container with id 635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d Jul 28 01:30:26.958344 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:26.958307 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" event={"ID":"402c321e-742e-4df2-a538-24431add2b2d","Type":"ContainerStarted","Data":"635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d"} Jul 28 01:30:28.656914 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:28.656883 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:30:28.668163 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:28.668132 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:30:28.671074 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:28.671048 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 01:30:33.987441 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:33.987406 2582 generic.go:356] "Generic (PLEG): container finished" podID="402c321e-742e-4df2-a538-24431add2b2d" containerID="779a5d78c28706027e0add10f26f2d8027c3453406f800c8283942a03029ef78" exitCode=0 Jul 28 01:30:33.987834 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:33.987466 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" event={"ID":"402c321e-742e-4df2-a538-24431add2b2d","Type":"ContainerDied","Data":"779a5d78c28706027e0add10f26f2d8027c3453406f800c8283942a03029ef78"} Jul 28 01:30:33.988499 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:33.988478 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 01:30:37.000836 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:37.000804 2582 generic.go:356] "Generic (PLEG): container finished" podID="402c321e-742e-4df2-a538-24431add2b2d" containerID="753db3b2d19b981a946f2368a81571f3d9308bc490cf29ad973501193b846107" exitCode=0 Jul 28 01:30:37.001209 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:37.000901 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" event={"ID":"402c321e-742e-4df2-a538-24431add2b2d","Type":"ContainerDied","Data":"753db3b2d19b981a946f2368a81571f3d9308bc490cf29ad973501193b846107"} Jul 28 01:30:45.036405 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:45.036374 2582 generic.go:356] "Generic (PLEG): container finished" podID="402c321e-742e-4df2-a538-24431add2b2d" containerID="d0ef2b5c390eb3443791d1ebb2d735852d459ed4b7d441b997d58ba647601045" exitCode=0 Jul 28 01:30:45.036726 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:45.036459 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" event={"ID":"402c321e-742e-4df2-a538-24431add2b2d","Type":"ContainerDied","Data":"d0ef2b5c390eb3443791d1ebb2d735852d459ed4b7d441b997d58ba647601045"} Jul 28 01:30:46.167497 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.167468 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:46.194236 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.194215 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle\") pod \"402c321e-742e-4df2-a538-24431add2b2d\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " Jul 28 01:30:46.194350 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.194243 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx6jh\" (UniqueName: \"kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh\") pod \"402c321e-742e-4df2-a538-24431add2b2d\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " Jul 28 01:30:46.194350 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.194278 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util\") pod \"402c321e-742e-4df2-a538-24431add2b2d\" (UID: \"402c321e-742e-4df2-a538-24431add2b2d\") " Jul 28 01:30:46.194844 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.194819 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle" (OuterVolumeSpecName: "bundle") pod "402c321e-742e-4df2-a538-24431add2b2d" (UID: "402c321e-742e-4df2-a538-24431add2b2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:30:46.196314 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.196288 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh" (OuterVolumeSpecName: "kube-api-access-tx6jh") pod "402c321e-742e-4df2-a538-24431add2b2d" (UID: "402c321e-742e-4df2-a538-24431add2b2d"). InnerVolumeSpecName "kube-api-access-tx6jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:30:46.198353 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.198329 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util" (OuterVolumeSpecName: "util") pod "402c321e-742e-4df2-a538-24431add2b2d" (UID: "402c321e-742e-4df2-a538-24431add2b2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:30:46.295012 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.294946 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-util\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:30:46.295012 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.294985 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402c321e-742e-4df2-a538-24431add2b2d-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:30:46.295012 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:46.294995 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx6jh\" (UniqueName: \"kubernetes.io/projected/402c321e-742e-4df2-a538-24431add2b2d-kube-api-access-tx6jh\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:30:47.045712 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:47.045684 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" Jul 28 01:30:47.045712 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:47.045686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b55lqcf" event={"ID":"402c321e-742e-4df2-a538-24431add2b2d","Type":"ContainerDied","Data":"635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d"} Jul 28 01:30:47.045883 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:47.045749 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="635568bf2a1ab6c1dd27f8c61294b0203d6e1856e9d75d9f20a0d1243816575d" Jul 28 01:30:52.499239 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:52.499198 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:53.545671 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545638 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56"] Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545900 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="extract" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545911 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="extract" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545929 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="util" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545935 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="util" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545946 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="pull" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.545966 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="pull" Jul 28 01:30:53.546048 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.546012 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="402c321e-742e-4df2-a538-24431add2b2d" containerName="extract" Jul 28 01:30:53.547684 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.547667 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.550370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.550343 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 01:30:53.550370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.550343 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 01:30:53.550556 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.550381 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 01:30:53.550556 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.550468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-mghhk\"" Jul 28 01:30:53.559920 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.559894 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56"] Jul 28 01:30:53.641118 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.641093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rk9g\" (UniqueName: \"kubernetes.io/projected/36c6339c-faa6-4ae0-a74d-8a9773228480-kube-api-access-6rk9g\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.641221 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.641135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36c6339c-faa6-4ae0-a74d-8a9773228480-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.741496 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.741472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rk9g\" (UniqueName: \"kubernetes.io/projected/36c6339c-faa6-4ae0-a74d-8a9773228480-kube-api-access-6rk9g\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.741584 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.741513 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36c6339c-faa6-4ae0-a74d-8a9773228480-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.743720 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.743698 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36c6339c-faa6-4ae0-a74d-8a9773228480-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.749986 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.749963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rk9g\" (UniqueName: \"kubernetes.io/projected/36c6339c-faa6-4ae0-a74d-8a9773228480-kube-api-access-6rk9g\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-z7t56\" (UID: \"36c6339c-faa6-4ae0-a74d-8a9773228480\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.857290 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.857221 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:53.978624 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.978592 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:53.998860 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:53.998834 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56"] Jul 28 01:30:54.002324 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:30:54.002299 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c6339c_faa6_4ae0_a74d_8a9773228480.slice/crio-116b9c2e40bb71169225f5ae4bd7ffd90df5b930d60b8d1441c18e7e3b3c6288 WatchSource:0}: Error finding container 116b9c2e40bb71169225f5ae4bd7ffd90df5b930d60b8d1441c18e7e3b3c6288: Status 404 returned error can't find the container with id 116b9c2e40bb71169225f5ae4bd7ffd90df5b930d60b8d1441c18e7e3b3c6288 Jul 28 01:30:54.077637 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:54.077610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" event={"ID":"36c6339c-faa6-4ae0-a74d-8a9773228480","Type":"ContainerStarted","Data":"116b9c2e40bb71169225f5ae4bd7ffd90df5b930d60b8d1441c18e7e3b3c6288"} Jul 28 01:30:57.842318 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:57.842283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.097494 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.097418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" event={"ID":"36c6339c-faa6-4ae0-a74d-8a9773228480","Type":"ContainerStarted","Data":"a07b1e0bbcdd3b5b27b82da055d77d770d1b6e8a78ebf82378117f71b49e69c6"} Jul 28 01:30:58.097647 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.097536 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:30:58.112308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.112256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.115815 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.115793 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-bl7wg"] Jul 28 01:30:58.117890 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.117872 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.120374 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.120349 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 01:30:58.120473 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.120378 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-zmlxg\"" Jul 28 01:30:58.120473 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.120349 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 28 01:30:58.125931 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.125886 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" podStartSLOduration=1.759748424 podStartE2EDuration="5.125868816s" totalImagesPullingTime="3.366120392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:30:58.124314149 +0000 UTC m=+329.880144660" watchObservedRunningTime="2026-07-28 01:30:58.125868816 +0000 UTC m=+329.881699330" Jul 28 01:30:58.129640 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.129616 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-bl7wg"] Jul 28 01:30:58.169188 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.169168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtmn\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-kube-api-access-2jtmn\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.169282 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.169219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.169282 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.169238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/42dbb550-0a72-4359-b884-a868cbfe7c9d-cabundle0\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.270165 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.270137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtmn\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-kube-api-access-2jtmn\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.270275 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.270206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.270275 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.270231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/42dbb550-0a72-4359-b884-a868cbfe7c9d-cabundle0\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.270391 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.270368 2582 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 28 01:30:58.270391 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.270391 2582 secret.go:281] references non-existent secret key: ca.crt Jul 28 01:30:58.270506 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.270403 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 01:30:58.270506 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.270418 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-bl7wg: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 28 01:30:58.270506 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.270468 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates podName:42dbb550-0a72-4359-b884-a868cbfe7c9d nodeName:}" failed. No retries permitted until 2026-07-28 01:30:58.770451386 +0000 UTC m=+330.526281884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates") pod "keda-operator-77f648d694-bl7wg" (UID: "42dbb550-0a72-4359-b884-a868cbfe7c9d") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 28 01:30:58.271015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.270993 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/42dbb550-0a72-4359-b884-a868cbfe7c9d-cabundle0\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.279067 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.279044 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtmn\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-kube-api-access-2jtmn\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.308015 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.307984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.311137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.311118 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5"] Jul 28 01:30:58.313118 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.313104 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.315255 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.315241 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 01:30:58.324483 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.324464 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5"] Jul 28 01:30:58.370667 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.370607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b6a52a72-57c9-4667-a082-d5ee2f205105-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.370667 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.370650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.370784 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.370760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmn2\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-kube-api-access-cwmn2\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.450330 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.450308 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.471226 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.471206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b6a52a72-57c9-4667-a082-d5ee2f205105-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.471314 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.471237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.471372 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.471327 2582 secret.go:281] references non-existent secret key: tls.crt Jul 28 01:30:58.471372 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.471337 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 28 01:30:58.471372 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.471351 2582 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 28 01:30:58.471372 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.471365 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 28 01:30:58.471524 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.471364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmn2\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-kube-api-access-cwmn2\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.471524 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.471401 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates podName:b6a52a72-57c9-4667-a082-d5ee2f205105 nodeName:}" failed. No retries permitted until 2026-07-28 01:30:58.971391106 +0000 UTC m=+330.727221598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates") pod "keda-metrics-apiserver-55557df8c-vbkk5" (UID: "b6a52a72-57c9-4667-a082-d5ee2f205105") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 28 01:30:58.471622 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.471606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b6a52a72-57c9-4667-a082-d5ee2f205105-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.481544 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.481518 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmn2\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-kube-api-access-cwmn2\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.657391 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.657340 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.774016 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.773991 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:58.774116 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.774105 2582 secret.go:281] references non-existent secret key: ca.crt Jul 28 01:30:58.774161 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.774121 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 01:30:58.774161 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.774128 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-bl7wg: references non-existent secret key: ca.crt Jul 28 01:30:58.774223 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:30:58.774172 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates podName:42dbb550-0a72-4359-b884-a868cbfe7c9d nodeName:}" failed. No retries permitted until 2026-07-28 01:30:59.774156431 +0000 UTC m=+331.529986922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates") pod "keda-operator-77f648d694-bl7wg" (UID: "42dbb550-0a72-4359-b884-a868cbfe7c9d") : references non-existent secret key: ca.crt Jul 28 01:30:58.975199 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.975128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.977511 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.977487 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b6a52a72-57c9-4667-a082-d5ee2f205105-certificates\") pod \"keda-metrics-apiserver-55557df8c-vbkk5\" (UID: \"b6a52a72-57c9-4667-a082-d5ee2f205105\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:58.979225 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.979205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:58.985105 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.985075 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rv54s"] Jul 28 01:30:58.987577 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.987560 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:58.989640 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.989622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 01:30:58.996114 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:58.995425 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rv54s"] Jul 28 01:30:59.075722 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.075698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hddxp\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-kube-api-access-hddxp\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.075818 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.075745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-certificates\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.076889 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.076866 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.176103 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.176080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hddxp\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-kube-api-access-hddxp\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.176194 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.176173 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-certificates\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.176936 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.176911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.178573 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.178551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-certificates\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.183362 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.183341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hddxp\" (UniqueName: \"kubernetes.io/projected/4c846514-952f-4e47-9e6f-e53b46447b90-kube-api-access-hddxp\") pod \"keda-admission-56f9798bb4-rv54s\" (UID: \"4c846514-952f-4e47-9e6f-e53b46447b90\") " pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.223207 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.223183 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:30:59.277366 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.277332 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.299544 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.299520 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:30:59.351636 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.351557 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5"] Jul 28 01:30:59.357158 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:30:59.357121 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a52a72_57c9_4667_a082_d5ee2f205105.slice/crio-c772530bddd9571739f9c0060215e23f531f8929f45c4e66623f699154e52022 WatchSource:0}: Error finding container c772530bddd9571739f9c0060215e23f531f8929f45c4e66623f699154e52022: Status 404 returned error can't find the container with id c772530bddd9571739f9c0060215e23f531f8929f45c4e66623f699154e52022 Jul 28 01:30:59.391828 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.391800 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.434637 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.434601 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rv54s"] Jul 28 01:30:59.437312 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:30:59.437289 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c846514_952f_4e47_9e6f_e53b46447b90.slice/crio-eddd411dca7c754acbe6d4197d925b28d8dbeb2c7295bbae553bc5bc6ad2dee9 WatchSource:0}: Error finding container eddd411dca7c754acbe6d4197d925b28d8dbeb2c7295bbae553bc5bc6ad2dee9: Status 404 returned error can't find the container with id eddd411dca7c754acbe6d4197d925b28d8dbeb2c7295bbae553bc5bc6ad2dee9 Jul 28 01:30:59.489272 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.489211 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.589675 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.589645 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:30:59.780724 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.780699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:59.782929 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.782898 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/42dbb550-0a72-4359-b884-a868cbfe7c9d-certificates\") pod \"keda-operator-77f648d694-bl7wg\" (UID: \"42dbb550-0a72-4359-b884-a868cbfe7c9d\") " pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:30:59.930267 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:30:59.930242 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:31:00.052041 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:00.052016 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-bl7wg"] Jul 28 01:31:00.054095 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:31:00.054071 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42dbb550_0a72_4359_b884_a868cbfe7c9d.slice/crio-0b60bdb30b32a96f784a12f772a6c22958a5e9ecdae202d83ba42ac3ff3ce1ea WatchSource:0}: Error finding container 0b60bdb30b32a96f784a12f772a6c22958a5e9ecdae202d83ba42ac3ff3ce1ea: Status 404 returned error can't find the container with id 0b60bdb30b32a96f784a12f772a6c22958a5e9ecdae202d83ba42ac3ff3ce1ea Jul 28 01:31:00.105612 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:00.105582 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" event={"ID":"4c846514-952f-4e47-9e6f-e53b46447b90","Type":"ContainerStarted","Data":"eddd411dca7c754acbe6d4197d925b28d8dbeb2c7295bbae553bc5bc6ad2dee9"} Jul 28 01:31:00.106689 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:00.106666 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" event={"ID":"b6a52a72-57c9-4667-a082-d5ee2f205105","Type":"ContainerStarted","Data":"c772530bddd9571739f9c0060215e23f531f8929f45c4e66623f699154e52022"} Jul 28 01:31:00.107631 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:00.107610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-bl7wg" event={"ID":"42dbb550-0a72-4359-b884-a868cbfe7c9d","Type":"ContainerStarted","Data":"0b60bdb30b32a96f784a12f772a6c22958a5e9ecdae202d83ba42ac3ff3ce1ea"} Jul 28 01:31:02.119458 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:02.119417 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" event={"ID":"4c846514-952f-4e47-9e6f-e53b46447b90","Type":"ContainerStarted","Data":"71e91d7e6b80ed5d7a93afcb9bbeb6fad9be49d849685cdc287b2658286da145"} Jul 28 01:31:02.119923 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:02.119526 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:31:02.136773 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:02.136725 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" podStartSLOduration=2.522545635 podStartE2EDuration="4.13670912s" totalImagesPullingTime="1.614163485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:31:02.134061074 +0000 UTC m=+333.889891603" watchObservedRunningTime="2026-07-28 01:31:02.13670912 +0000 UTC m=+333.892539634" Jul 28 01:31:03.127259 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:03.127219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" event={"ID":"b6a52a72-57c9-4667-a082-d5ee2f205105","Type":"ContainerStarted","Data":"cb7beb8d7aee6952e0e443afa86ef736e4097e1833a28176e062b52c07a912c7"} Jul 28 01:31:03.128009 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:03.127441 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:31:03.142545 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:03.142503 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" podStartSLOduration=2.19615263 podStartE2EDuration="5.14248848s" totalImagesPullingTime="2.94633585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:31:03.142054271 +0000 UTC m=+334.897884781" watchObservedRunningTime="2026-07-28 01:31:03.14248848 +0000 UTC m=+334.898318992" Jul 28 01:31:05.137623 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:05.137590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-bl7wg" event={"ID":"42dbb550-0a72-4359-b884-a868cbfe7c9d","Type":"ContainerStarted","Data":"89eaad080b60ac55aad7c137e162ebdc4e7de9446a1ee3c803b006d9f396aa77"} Jul 28 01:31:05.137993 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:05.137826 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:31:05.155370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:05.155326 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-bl7wg" podStartSLOduration=2.846706036 podStartE2EDuration="7.155312006s" totalImagesPullingTime="4.30860597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:31:05.154588975 +0000 UTC m=+336.910419503" watchObservedRunningTime="2026-07-28 01:31:05.155312006 +0000 UTC m=+336.911142530" Jul 28 01:31:14.136158 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:14.136130 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-vbkk5" Jul 28 01:31:19.104292 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:19.104260 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-z7t56" Jul 28 01:31:23.129828 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:23.129752 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-rv54s" Jul 28 01:31:25.696651 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:25.696603 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:31:25.752005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:25.751975 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:31:26.144315 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:31:26.144287 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-bl7wg" Jul 28 01:32:15.412714 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.412668 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:15.464017 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.463985 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:32:15.467199 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.467182 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.469573 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.469546 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jdcgg\"" Jul 28 01:32:15.469756 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.469555 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 01:32:15.470606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.470587 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 01:32:15.470703 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.470647 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 01:32:15.472338 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.472317 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-4bbbl"] Jul 28 01:32:15.475262 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.475214 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.478014 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.477993 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 28 01:32:15.478274 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.478144 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:32:15.478274 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.478224 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-6wsxm\"" Jul 28 01:32:15.484738 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.484718 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-4bbbl"] Jul 28 01:32:15.491124 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.491055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:15.502092 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.497000 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-rfxrz"] Jul 28 01:32:15.502987 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.502966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.505645 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.505478 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7vs28\"" Jul 28 01:32:15.505747 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.505664 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 01:32:15.507123 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.507101 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-rfxrz"] Jul 28 01:32:15.569590 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.569562 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:15.613232 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.613327 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-data\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.613327 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmrd\" (UniqueName: \"kubernetes.io/projected/2eb9065d-4975-4d79-8807-a1d254849d8c-kube-api-access-vnmrd\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.613327 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb9065d-4975-4d79-8807-a1d254849d8c-cert\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.613484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613350 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzh5\" (UniqueName: \"kubernetes.io/projected/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-kube-api-access-7pzh5\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.613484 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.613404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsmf\" (UniqueName: \"kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.684615 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.684546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:15.713686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.713771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-data\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.713771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmrd\" (UniqueName: \"kubernetes.io/projected/2eb9065d-4975-4d79-8807-a1d254849d8c-kube-api-access-vnmrd\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.713771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb9065d-4975-4d79-8807-a1d254849d8c-cert\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.713771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzh5\" (UniqueName: \"kubernetes.io/projected/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-kube-api-access-7pzh5\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.713945 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.713795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsmf\" (UniqueName: \"kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.714034 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:32:15.714007 2582 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 28 01:32:15.714134 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:32:15.714110 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert podName:773008dd-cec9-456a-837a-3233e4f94307 nodeName:}" failed. No retries permitted until 2026-07-28 01:32:16.214089278 +0000 UTC m=+407.969919772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert") pod "kserve-controller-manager-ff96d5959-gv7qw" (UID: "773008dd-cec9-456a-837a-3233e4f94307") : secret "kserve-webhook-server-cert" not found Jul 28 01:32:15.714134 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.714115 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-data\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.716058 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.716038 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb9065d-4975-4d79-8807-a1d254849d8c-cert\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.722611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.722589 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmrd\" (UniqueName: \"kubernetes.io/projected/2eb9065d-4975-4d79-8807-a1d254849d8c-kube-api-access-vnmrd\") pod \"llmisvc-controller-manager-84fc959947-4bbbl\" (UID: \"2eb9065d-4975-4d79-8807-a1d254849d8c\") " pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.722611 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.722595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsmf\" (UniqueName: \"kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:15.722874 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.722853 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzh5\" (UniqueName: \"kubernetes.io/projected/6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631-kube-api-access-7pzh5\") pod \"seaweedfs-64568bcd49-rfxrz\" (UID: \"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631\") " pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.791131 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.791111 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:15.814264 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.814201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:15.824634 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.824592 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:15.931833 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.931798 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-4bbbl"] Jul 28 01:32:15.935012 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:32:15.934911 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2eb9065d_4975_4d79_8807_a1d254849d8c.slice/crio-875afd04a7d0607753e6b87b4640ac2075c09a002b01da8753c95fb23a74b891 WatchSource:0}: Error finding container 875afd04a7d0607753e6b87b4640ac2075c09a002b01da8753c95fb23a74b891: Status 404 returned error can't find the container with id 875afd04a7d0607753e6b87b4640ac2075c09a002b01da8753c95fb23a74b891 Jul 28 01:32:15.954448 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:15.954422 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-rfxrz"] Jul 28 01:32:15.956638 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:32:15.956616 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc99ce5_9e7b_4ef3_87b9_1ed32db9b631.slice/crio-afd40ed66f9dc302c18edbcc4f6859266b1bbc16ccf3664ab86ae27c380f0a8f WatchSource:0}: Error finding container afd40ed66f9dc302c18edbcc4f6859266b1bbc16ccf3664ab86ae27c380f0a8f: Status 404 returned error can't find the container with id afd40ed66f9dc302c18edbcc4f6859266b1bbc16ccf3664ab86ae27c380f0a8f Jul 28 01:32:16.218634 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.218561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:16.220775 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.220757 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") pod \"kserve-controller-manager-ff96d5959-gv7qw\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:16.357114 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.357079 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:16.380806 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.380784 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:16.410561 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.410536 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:16.436783 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.436751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" event={"ID":"2eb9065d-4975-4d79-8807-a1d254849d8c","Type":"ContainerStarted","Data":"875afd04a7d0607753e6b87b4640ac2075c09a002b01da8753c95fb23a74b891"} Jul 28 01:32:16.437945 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.437919 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-rfxrz" event={"ID":"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631","Type":"ContainerStarted","Data":"afd40ed66f9dc302c18edbcc4f6859266b1bbc16ccf3664ab86ae27c380f0a8f"} Jul 28 01:32:16.509830 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:16.509805 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:32:16.511815 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:32:16.511789 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773008dd_cec9_456a_837a_3233e4f94307.slice/crio-6be7c6d7bc0ff75c77f88d6f819c88e21b30c528fc96038b1875918b12cd408d WatchSource:0}: Error finding container 6be7c6d7bc0ff75c77f88d6f819c88e21b30c528fc96038b1875918b12cd408d: Status 404 returned error can't find the container with id 6be7c6d7bc0ff75c77f88d6f819c88e21b30c528fc96038b1875918b12cd408d Jul 28 01:32:17.446184 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:17.446138 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" event={"ID":"773008dd-cec9-456a-837a-3233e4f94307","Type":"ContainerStarted","Data":"6be7c6d7bc0ff75c77f88d6f819c88e21b30c528fc96038b1875918b12cd408d"} Jul 28 01:32:21.470689 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.470646 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-rfxrz" event={"ID":"6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631","Type":"ContainerStarted","Data":"b25d964b792b64e9e422bd9ce60bf2fe0e8354eefb62ad2db4470b43c7588a72"} Jul 28 01:32:21.471166 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.470716 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:21.472991 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.472938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" event={"ID":"773008dd-cec9-456a-837a-3233e4f94307","Type":"ContainerStarted","Data":"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902"} Jul 28 01:32:21.473107 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.473014 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:21.484769 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.484720 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-rfxrz" podStartSLOduration=1.5056729930000001 podStartE2EDuration="6.484703851s" totalImagesPullingTime="4.979030858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:32:21.484129086 +0000 UTC m=+413.239959613" watchObservedRunningTime="2026-07-28 01:32:21.484703851 +0000 UTC m=+413.240534365" Jul 28 01:32:21.499708 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:21.499666 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" podStartSLOduration=2.671594353 podStartE2EDuration="6.499653576s" totalImagesPullingTime="3.828059223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:32:21.497928481 +0000 UTC m=+413.253758994" watchObservedRunningTime="2026-07-28 01:32:21.499653576 +0000 UTC m=+413.255484120" Jul 28 01:32:23.483884 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:23.483850 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" event={"ID":"2eb9065d-4975-4d79-8807-a1d254849d8c","Type":"ContainerStarted","Data":"0ba4a24ac8ee725810c4336dd726ced8d8d60d663a80ad2057028ea296dbcc57"} Jul 28 01:32:23.484293 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:23.483929 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:32:23.500121 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:23.500076 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" podStartSLOduration=1.740784806 podStartE2EDuration="8.500062017s" totalImagesPullingTime="6.759277211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:32:23.498305904 +0000 UTC m=+415.254136417" watchObservedRunningTime="2026-07-28 01:32:23.500062017 +0000 UTC m=+415.255892530" Jul 28 01:32:27.480581 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:27.480552 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-rfxrz" Jul 28 01:32:38.239373 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.239343 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668d4bffdc-5wvf6"] Jul 28 01:32:38.244160 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.244135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.255176 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.255148 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668d4bffdc-5wvf6"] Jul 28 01:32:38.378299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-oauth-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378418 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlbc\" (UniqueName: \"kubernetes.io/projected/99df4e62-4120-4b00-a989-0ba200b94950-kube-api-access-krlbc\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378418 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-console-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-service-ca\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378514 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-oauth-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.378606 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.378535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-trusted-ca-bundle\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479591 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlbc\" (UniqueName: \"kubernetes.io/projected/99df4e62-4120-4b00-a989-0ba200b94950-kube-api-access-krlbc\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-console-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-service-ca\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-oauth-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479685 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-trusted-ca-bundle\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.479742 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.479741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-oauth-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.480482 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.480456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-console-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.480576 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.480529 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-oauth-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.480707 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.480687 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-service-ca\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.480743 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.480705 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99df4e62-4120-4b00-a989-0ba200b94950-trusted-ca-bundle\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.482158 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.482136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-serving-cert\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.482248 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.482207 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99df4e62-4120-4b00-a989-0ba200b94950-console-oauth-config\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.487582 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.487564 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlbc\" (UniqueName: \"kubernetes.io/projected/99df4e62-4120-4b00-a989-0ba200b94950-kube-api-access-krlbc\") pod \"console-668d4bffdc-5wvf6\" (UID: \"99df4e62-4120-4b00-a989-0ba200b94950\") " pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.553864 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.553842 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:38.684456 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.684384 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668d4bffdc-5wvf6"] Jul 28 01:32:38.686574 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:32:38.686543 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99df4e62_4120_4b00_a989_0ba200b94950.slice/crio-e2b029e06c5ed3dc0ed546d6f6954c7e6242d01f85db7d41f6ef79e9d6b85e37 WatchSource:0}: Error finding container e2b029e06c5ed3dc0ed546d6f6954c7e6242d01f85db7d41f6ef79e9d6b85e37: Status 404 returned error can't find the container with id e2b029e06c5ed3dc0ed546d6f6954c7e6242d01f85db7d41f6ef79e9d6b85e37 Jul 28 01:32:38.853064 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.852977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:38.953363 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:38.953331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:39.053183 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:39.053149 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:39.105445 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:39.105390 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:39.549624 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:39.549595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668d4bffdc-5wvf6" event={"ID":"99df4e62-4120-4b00-a989-0ba200b94950","Type":"ContainerStarted","Data":"63755b4e2698f381eaa578b4ae8b1662d2961435ebfb7012fb38507c62f72f3a"} Jul 28 01:32:39.550049 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:39.549644 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668d4bffdc-5wvf6" event={"ID":"99df4e62-4120-4b00-a989-0ba200b94950","Type":"ContainerStarted","Data":"e2b029e06c5ed3dc0ed546d6f6954c7e6242d01f85db7d41f6ef79e9d6b85e37"} Jul 28 01:32:39.566834 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:39.566792 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668d4bffdc-5wvf6" podStartSLOduration=1.5667791420000001 podStartE2EDuration="1.566779142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:32:39.565437085 +0000 UTC m=+431.321267597" watchObservedRunningTime="2026-07-28 01:32:39.566779142 +0000 UTC m=+431.322609654" Jul 28 01:32:48.554585 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.554549 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:48.555032 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.554628 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:48.559408 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.559382 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:48.592844 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.592820 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668d4bffdc-5wvf6" Jul 28 01:32:48.637869 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.637843 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:32:48.736197 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.736157 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:48.836740 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.836669 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:48.893770 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:48.893741 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:32:52.483771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:52.483691 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:32:54.490432 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:32:54.490404 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-4bbbl" Jul 28 01:33:01.208041 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.208006 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:33:01.208456 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.208205 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" podUID="773008dd-cec9-456a-837a-3233e4f94307" containerName="manager" containerID="cri-o://d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902" gracePeriod=10 Jul 28 01:33:01.234989 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.234966 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-g58wx"] Jul 28 01:33:01.237142 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.237125 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.250108 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.250085 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-g58wx"] Jul 28 01:33:01.347439 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.347413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b78b6ca-a366-4845-964e-89a6f4d5a552-cert\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.347522 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.347450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwgn\" (UniqueName: \"kubernetes.io/projected/5b78b6ca-a366-4845-964e-89a6f4d5a552-kube-api-access-7bwgn\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.441650 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.441627 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:33:01.448439 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.448418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b78b6ca-a366-4845-964e-89a6f4d5a552-cert\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.448527 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.448447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwgn\" (UniqueName: \"kubernetes.io/projected/5b78b6ca-a366-4845-964e-89a6f4d5a552-kube-api-access-7bwgn\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.450546 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.450515 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b78b6ca-a366-4845-964e-89a6f4d5a552-cert\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.455800 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.455777 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwgn\" (UniqueName: \"kubernetes.io/projected/5b78b6ca-a366-4845-964e-89a6f4d5a552-kube-api-access-7bwgn\") pod \"kserve-controller-manager-ff96d5959-g58wx\" (UID: \"5b78b6ca-a366-4845-964e-89a6f4d5a552\") " pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.549499 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.549475 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgsmf\" (UniqueName: \"kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf\") pod \"773008dd-cec9-456a-837a-3233e4f94307\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " Jul 28 01:33:01.549623 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.549546 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") pod \"773008dd-cec9-456a-837a-3233e4f94307\" (UID: \"773008dd-cec9-456a-837a-3233e4f94307\") " Jul 28 01:33:01.551530 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.551502 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert" (OuterVolumeSpecName: "cert") pod "773008dd-cec9-456a-837a-3233e4f94307" (UID: "773008dd-cec9-456a-837a-3233e4f94307"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:33:01.551627 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.551549 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf" (OuterVolumeSpecName: "kube-api-access-qgsmf") pod "773008dd-cec9-456a-837a-3233e4f94307" (UID: "773008dd-cec9-456a-837a-3233e4f94307"). InnerVolumeSpecName "kube-api-access-qgsmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:33:01.588708 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.588687 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:01.648376 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.648347 2582 generic.go:356] "Generic (PLEG): container finished" podID="773008dd-cec9-456a-837a-3233e4f94307" containerID="d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902" exitCode=0 Jul 28 01:33:01.648520 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.648390 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" Jul 28 01:33:01.648520 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.648458 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" event={"ID":"773008dd-cec9-456a-837a-3233e4f94307","Type":"ContainerDied","Data":"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902"} Jul 28 01:33:01.648520 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.648506 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-gv7qw" event={"ID":"773008dd-cec9-456a-837a-3233e4f94307","Type":"ContainerDied","Data":"6be7c6d7bc0ff75c77f88d6f819c88e21b30c528fc96038b1875918b12cd408d"} Jul 28 01:33:01.648682 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.648536 2582 scope.go:117] "RemoveContainer" containerID="d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902" Jul 28 01:33:01.650241 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.650215 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgsmf\" (UniqueName: \"kubernetes.io/projected/773008dd-cec9-456a-837a-3233e4f94307-kube-api-access-qgsmf\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:01.650241 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.650241 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773008dd-cec9-456a-837a-3233e4f94307-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:01.657894 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.657879 2582 scope.go:117] "RemoveContainer" containerID="d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902" Jul 28 01:33:01.658155 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:33:01.658134 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902\": container with ID starting with d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902 not found: ID does not exist" containerID="d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902" Jul 28 01:33:01.658224 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.658167 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902"} err="failed to get container status \"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902\": rpc error: code = NotFound desc = could not find container \"d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902\": container with ID starting with d5ddb54cc57b1cd2fc8855df052b3a4a0f0c426721543579cca5326950d13902 not found: ID does not exist" Jul 28 01:33:01.670968 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.670921 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:33:01.675162 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.675138 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-gv7qw"] Jul 28 01:33:01.717835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:01.717782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-g58wx"] Jul 28 01:33:01.720433 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:33:01.720408 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b78b6ca_a366_4845_964e_89a6f4d5a552.slice/crio-aa6293f48a77853694069c9127b4b9b74dbb204e00459be03216925e2518d4fc WatchSource:0}: Error finding container aa6293f48a77853694069c9127b4b9b74dbb204e00459be03216925e2518d4fc: Status 404 returned error can't find the container with id aa6293f48a77853694069c9127b4b9b74dbb204e00459be03216925e2518d4fc Jul 28 01:33:02.653933 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:02.653897 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" event={"ID":"5b78b6ca-a366-4845-964e-89a6f4d5a552","Type":"ContainerStarted","Data":"0f48b3db0d84ed3dc2735ca1d8b560a2c9b517e7c72adddb1971bcfc83711c99"} Jul 28 01:33:02.654379 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:02.654072 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:02.654379 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:02.654107 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" event={"ID":"5b78b6ca-a366-4845-964e-89a6f4d5a552","Type":"ContainerStarted","Data":"aa6293f48a77853694069c9127b4b9b74dbb204e00459be03216925e2518d4fc"} Jul 28 01:33:02.669839 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:02.669798 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" podStartSLOduration=1.272869359 podStartE2EDuration="1.669783585s" totalImagesPullingTime="396.914226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:33:02.668543824 +0000 UTC m=+454.424374337" watchObservedRunningTime="2026-07-28 01:33:02.669783585 +0000 UTC m=+454.425614097" Jul 28 01:33:02.804354 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:02.804331 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773008dd-cec9-456a-837a-3233e4f94307" path="/var/lib/kubelet/pods/773008dd-cec9-456a-837a-3233e4f94307/volumes" Jul 28 01:33:13.662186 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.662122 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54794bb77b-n6s8l" podUID="078e07c6-92b6-4b61-af47-c8a7dab26f83" containerName="console" containerID="cri-o://4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063" gracePeriod=15 Jul 28 01:33:13.890787 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.890765 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:33:13.930657 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930600 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.930657 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930646 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.930835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930683 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.930835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930700 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnkz5\" (UniqueName: \"kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.930835 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930717 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.931029 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930893 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.931029 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.930943 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca\") pod \"078e07c6-92b6-4b61-af47-c8a7dab26f83\" (UID: \"078e07c6-92b6-4b61-af47-c8a7dab26f83\") " Jul 28 01:33:13.931132 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931082 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config" (OuterVolumeSpecName: "console-config") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:33:13.931193 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931158 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:33:13.931193 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931171 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:33:13.931299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931259 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:13.931299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931277 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-oauth-serving-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:13.931299 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931291 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-trusted-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:13.931539 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.931513 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca" (OuterVolumeSpecName: "service-ca") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:33:13.932899 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.932881 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:33:13.933021 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.932973 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5" (OuterVolumeSpecName: "kube-api-access-bnkz5") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "kube-api-access-bnkz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:33:13.933087 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:13.933049 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "078e07c6-92b6-4b61-af47-c8a7dab26f83" (UID: "078e07c6-92b6-4b61-af47-c8a7dab26f83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:33:14.031770 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.031744 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-serving-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:14.031770 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.031767 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078e07c6-92b6-4b61-af47-c8a7dab26f83-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:14.031922 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.031776 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnkz5\" (UniqueName: \"kubernetes.io/projected/078e07c6-92b6-4b61-af47-c8a7dab26f83-kube-api-access-bnkz5\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:14.031922 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.031786 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078e07c6-92b6-4b61-af47-c8a7dab26f83-console-oauth-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:33:14.707137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.707105 2582 generic.go:356] "Generic (PLEG): container finished" podID="078e07c6-92b6-4b61-af47-c8a7dab26f83" containerID="4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063" exitCode=0 Jul 28 01:33:14.707588 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.707159 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54794bb77b-n6s8l" event={"ID":"078e07c6-92b6-4b61-af47-c8a7dab26f83","Type":"ContainerDied","Data":"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063"} Jul 28 01:33:14.707588 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.707160 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54794bb77b-n6s8l" Jul 28 01:33:14.707588 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.707201 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54794bb77b-n6s8l" event={"ID":"078e07c6-92b6-4b61-af47-c8a7dab26f83","Type":"ContainerDied","Data":"1b9cd009698461c5e2e41e3cc9b0befea2657395b060d97979962c871bfa15cc"} Jul 28 01:33:14.707588 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.707222 2582 scope.go:117] "RemoveContainer" containerID="4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063" Jul 28 01:33:14.716398 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.716380 2582 scope.go:117] "RemoveContainer" containerID="4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063" Jul 28 01:33:14.716654 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:33:14.716632 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063\": container with ID starting with 4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063 not found: ID does not exist" containerID="4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063" Jul 28 01:33:14.716718 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.716662 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063"} err="failed to get container status \"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063\": rpc error: code = NotFound desc = could not find container \"4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063\": container with ID starting with 4b32edc48d0d0271a276f264fe525e198cdd856175954bd2762890207b19c063 not found: ID does not exist" Jul 28 01:33:14.728681 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.728654 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:33:14.730399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.730377 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54794bb77b-n6s8l"] Jul 28 01:33:14.804964 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:14.804938 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="078e07c6-92b6-4b61-af47-c8a7dab26f83" path="/var/lib/kubelet/pods/078e07c6-92b6-4b61-af47-c8a7dab26f83/volumes" Jul 28 01:33:33.664181 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:33.664149 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-ff96d5959-g58wx" Jul 28 01:33:34.618660 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:34.618625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:34.698599 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:34.698560 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:34.859675 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:34.859642 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:34.964255 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:34.964186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:35.254287 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:35.254251 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:35.307352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:35.307326 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:33:49.105802 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:33:49.105765 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:11.742898 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.742862 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743205 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="078e07c6-92b6-4b61-af47-c8a7dab26f83" containerName="console" Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743220 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="078e07c6-92b6-4b61-af47-c8a7dab26f83" containerName="console" Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743239 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773008dd-cec9-456a-837a-3233e4f94307" containerName="manager" Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743245 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773008dd-cec9-456a-837a-3233e4f94307" containerName="manager" Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743297 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="078e07c6-92b6-4b61-af47-c8a7dab26f83" containerName="console" Jul 28 01:35:11.743308 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.743305 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="773008dd-cec9-456a-837a-3233e4f94307" containerName="manager" Jul 28 01:35:11.746142 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.746124 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.748293 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.748273 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 28 01:35:11.752529 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.752500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:11.753268 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.752856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:11.853794 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.853772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.853884 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.853806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9c6r\" (UniqueName: \"kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.954304 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.954283 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9c6r\" (UniqueName: \"kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.954405 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.954338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.954615 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.954600 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:11.962961 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:11.962931 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9c6r\" (UniqueName: \"kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r\") pod \"seaweedfs-tls-custom-6644bf5d6c-zgx2j\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:12.056136 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:12.056090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:12.179137 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:12.179114 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:12.181153 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:35:12.181126 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3951ee_5985_431c_a392_0b340927fc8a.slice/crio-239ac9d5123c8b70b3f57b22252f0afdd2b0da7960750b9780de9d6f90e61f74 WatchSource:0}: Error finding container 239ac9d5123c8b70b3f57b22252f0afdd2b0da7960750b9780de9d6f90e61f74: Status 404 returned error can't find the container with id 239ac9d5123c8b70b3f57b22252f0afdd2b0da7960750b9780de9d6f90e61f74 Jul 28 01:35:12.223933 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:12.223899 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" event={"ID":"2d3951ee-5985-431c-a392-0b340927fc8a","Type":"ContainerStarted","Data":"239ac9d5123c8b70b3f57b22252f0afdd2b0da7960750b9780de9d6f90e61f74"} Jul 28 01:35:13.229356 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:13.229322 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" event={"ID":"2d3951ee-5985-431c-a392-0b340927fc8a","Type":"ContainerStarted","Data":"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b"} Jul 28 01:35:13.245427 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:13.245380 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" podStartSLOduration=1.9644193639999998 podStartE2EDuration="2.245365553s" totalImagesPullingTime="280.946189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:13.243744416 +0000 UTC m=+584.999574931" watchObservedRunningTime="2026-07-28 01:35:13.245365553 +0000 UTC m=+585.001196065" Jul 28 01:35:14.590886 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:14.590851 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:15.237460 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:15.237421 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" podUID="2d3951ee-5985-431c-a392-0b340927fc8a" containerName="seaweedfs-tls-custom" containerID="cri-o://41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b" gracePeriod=30 Jul 28 01:35:16.478727 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.478697 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:16.591439 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.591381 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9c6r\" (UniqueName: \"kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r\") pod \"2d3951ee-5985-431c-a392-0b340927fc8a\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " Jul 28 01:35:16.591555 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.591470 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data\") pod \"2d3951ee-5985-431c-a392-0b340927fc8a\" (UID: \"2d3951ee-5985-431c-a392-0b340927fc8a\") " Jul 28 01:35:16.592744 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.592723 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data" (OuterVolumeSpecName: "data") pod "2d3951ee-5985-431c-a392-0b340927fc8a" (UID: "2d3951ee-5985-431c-a392-0b340927fc8a"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:16.593399 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.593376 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r" (OuterVolumeSpecName: "kube-api-access-q9c6r") pod "2d3951ee-5985-431c-a392-0b340927fc8a" (UID: "2d3951ee-5985-431c-a392-0b340927fc8a"). InnerVolumeSpecName "kube-api-access-q9c6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:35:16.692997 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.692948 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9c6r\" (UniqueName: \"kubernetes.io/projected/2d3951ee-5985-431c-a392-0b340927fc8a-kube-api-access-q9c6r\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:35:16.692997 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:16.692995 2582 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d3951ee-5985-431c-a392-0b340927fc8a-data\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 28 01:35:17.247291 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.247258 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d3951ee-5985-431c-a392-0b340927fc8a" containerID="41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b" exitCode=0 Jul 28 01:35:17.247450 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.247304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" event={"ID":"2d3951ee-5985-431c-a392-0b340927fc8a","Type":"ContainerDied","Data":"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b"} Jul 28 01:35:17.247450 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.247322 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" Jul 28 01:35:17.247450 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.247378 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j" event={"ID":"2d3951ee-5985-431c-a392-0b340927fc8a","Type":"ContainerDied","Data":"239ac9d5123c8b70b3f57b22252f0afdd2b0da7960750b9780de9d6f90e61f74"} Jul 28 01:35:17.247450 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.247400 2582 scope.go:117] "RemoveContainer" containerID="41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b" Jul 28 01:35:17.258599 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.258581 2582 scope.go:117] "RemoveContainer" containerID="41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b" Jul 28 01:35:17.258870 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:35:17.258849 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b\": container with ID starting with 41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b not found: ID does not exist" containerID="41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b" Jul 28 01:35:17.258914 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.258882 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b"} err="failed to get container status \"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b\": rpc error: code = NotFound desc = could not find container \"41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b\": container with ID starting with 41b5edea638095dc000c0de3e3268facdc752b8606d42ddf83fc6401c4e2f70b not found: ID does not exist" Jul 28 01:35:17.265917 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.265895 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:17.270127 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.270108 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-zgx2j"] Jul 28 01:35:17.300097 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.300074 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-hkqvf"] Jul 28 01:35:17.300414 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.300398 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3951ee-5985-431c-a392-0b340927fc8a" containerName="seaweedfs-tls-custom" Jul 28 01:35:17.300485 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.300417 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3951ee-5985-431c-a392-0b340927fc8a" containerName="seaweedfs-tls-custom" Jul 28 01:35:17.300534 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.300522 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3951ee-5985-431c-a392-0b340927fc8a" containerName="seaweedfs-tls-custom" Jul 28 01:35:17.304844 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.304825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.307480 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.307458 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 28 01:35:17.307566 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.307523 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 28 01:35:17.311339 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.311269 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-hkqvf"] Jul 28 01:35:17.397942 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.397911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jmj\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-kube-api-access-z9jmj\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.398085 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.397993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ec484e-20b3-42bc-a49a-43e1ce12c56a-data\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.398085 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.398023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.498853 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.498790 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jmj\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-kube-api-access-z9jmj\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.498853 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.498838 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ec484e-20b3-42bc-a49a-43e1ce12c56a-data\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.499250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.498868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.499250 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.499234 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ec484e-20b3-42bc-a49a-43e1ce12c56a-data\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.501403 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.501382 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.507091 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.507068 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jmj\" (UniqueName: \"kubernetes.io/projected/27ec484e-20b3-42bc-a49a-43e1ce12c56a-kube-api-access-z9jmj\") pod \"seaweedfs-tls-custom-8b44d767d-hkqvf\" (UID: \"27ec484e-20b3-42bc-a49a-43e1ce12c56a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.614235 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.614215 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" Jul 28 01:35:17.742266 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:17.742237 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-hkqvf"] Jul 28 01:35:17.743643 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:35:17.743614 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ec484e_20b3_42bc_a49a_43e1ce12c56a.slice/crio-99004b3dbbb755c8c8157035171daca41fda56372a75e45ebe4f5ad0ea96f3c0 WatchSource:0}: Error finding container 99004b3dbbb755c8c8157035171daca41fda56372a75e45ebe4f5ad0ea96f3c0: Status 404 returned error can't find the container with id 99004b3dbbb755c8c8157035171daca41fda56372a75e45ebe4f5ad0ea96f3c0 Jul 28 01:35:18.252900 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:18.252862 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" event={"ID":"27ec484e-20b3-42bc-a49a-43e1ce12c56a","Type":"ContainerStarted","Data":"7560ee1a3410f4b3b4bb21e11a5e9a0f6d1676a9e8bcf6aaa7d539e05d854962"} Jul 28 01:35:18.253072 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:18.252922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" event={"ID":"27ec484e-20b3-42bc-a49a-43e1ce12c56a","Type":"ContainerStarted","Data":"99004b3dbbb755c8c8157035171daca41fda56372a75e45ebe4f5ad0ea96f3c0"} Jul 28 01:35:18.268597 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:18.268548 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-hkqvf" podStartSLOduration=0.98269027 podStartE2EDuration="1.268533419s" totalImagesPullingTime="285.843149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:18.266905413 +0000 UTC m=+590.022735926" watchObservedRunningTime="2026-07-28 01:35:18.268533419 +0000 UTC m=+590.024363932" Jul 28 01:35:18.805473 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:18.805438 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3951ee-5985-431c-a392-0b340927fc8a" path="/var/lib/kubelet/pods/2d3951ee-5985-431c-a392-0b340927fc8a/volumes" Jul 28 01:35:19.983103 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:19.983067 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:28.693173 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:28.693138 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:35:28.698780 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:28.698753 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:35:29.753630 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.753596 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt"] Jul 28 01:35:29.758146 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.758125 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.759170 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.759137 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:29.760686 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.760666 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 28 01:35:29.760784 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.760682 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 28 01:35:29.763370 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.763350 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt"] Jul 28 01:35:29.894036 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.894013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.894144 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.894125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.894208 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.894177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhxv\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-kube-api-access-hjhxv\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.994622 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.994599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhxv\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-kube-api-access-hjhxv\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.994722 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.994631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.994785 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.994769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.994879 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:35:29.994865 2582 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 28 01:35:29.994879 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:35:29.994879 2582 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt: secret "seaweedfs-tls-serving" not found Jul 28 01:35:29.994999 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:29.994913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:29.994999 ip-10-0-138-146 kubenswrapper[2582]: E0728 01:35:29.994922 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving podName:73c0b40d-5ab6-4400-b6b9-51fce1c9396c nodeName:}" failed. No retries permitted until 2026-07-28 01:35:30.494908604 +0000 UTC m=+602.250739099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-jk8pt" (UID: "73c0b40d-5ab6-4400-b6b9-51fce1c9396c") : secret "seaweedfs-tls-serving" not found Jul 28 01:35:30.005125 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.005076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhxv\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-kube-api-access-hjhxv\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:30.447394 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.447312 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:30.497826 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.497803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:30.500129 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.500112 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/73c0b40d-5ab6-4400-b6b9-51fce1c9396c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-jk8pt\" (UID: \"73c0b40d-5ab6-4400-b6b9-51fce1c9396c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:30.669001 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.668980 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" Jul 28 01:35:30.794940 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:30.794917 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt"] Jul 28 01:35:30.797259 ip-10-0-138-146 kubenswrapper[2582]: W0728 01:35:30.797233 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c0b40d_5ab6_4400_b6b9_51fce1c9396c.slice/crio-2ca24ad6194b6e71298430641ac7fb68110e52c4d7d798c0c0d610e00f000a90 WatchSource:0}: Error finding container 2ca24ad6194b6e71298430641ac7fb68110e52c4d7d798c0c0d610e00f000a90: Status 404 returned error can't find the container with id 2ca24ad6194b6e71298430641ac7fb68110e52c4d7d798c0c0d610e00f000a90 Jul 28 01:35:31.314383 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:31.314347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" event={"ID":"73c0b40d-5ab6-4400-b6b9-51fce1c9396c","Type":"ContainerStarted","Data":"9dab6a9d1693efde2d62a4e36a37869a4dcb9c4de2956f7d120f5b3588891481"} Jul 28 01:35:31.314544 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:31.314401 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" event={"ID":"73c0b40d-5ab6-4400-b6b9-51fce1c9396c","Type":"ContainerStarted","Data":"2ca24ad6194b6e71298430641ac7fb68110e52c4d7d798c0c0d610e00f000a90"} Jul 28 01:35:31.332005 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:31.331902 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-jk8pt" podStartSLOduration=2.061388271 podStartE2EDuration="2.331887912s" totalImagesPullingTime="270.499641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:31.330772826 +0000 UTC m=+603.086603354" watchObservedRunningTime="2026-07-28 01:35:31.331887912 +0000 UTC m=+603.087718424" Jul 28 01:35:45.558630 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:45.558590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:45.660323 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:45.660284 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:57.964093 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:57.964013 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:35:59.415911 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:35:59.415875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:36:32.279108 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:36:32.279059 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:37:43.158848 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:37:43.158757 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:37:43.302027 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:37:43.301977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:37:43.518148 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:37:43.518116 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:38:48.047533 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:38:48.047485 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:39:08.334289 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:39:08.334256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:39:08.409319 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:39:08.409285 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:39:08.487130 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:39:08.487097 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:39:28.372335 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:39:28.372292 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:39:29.121771 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:39:29.121722 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:01.219539 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:01.219500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:01.320482 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:01.320430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:24.430867 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:24.430781 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:28.723432 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:28.723403 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:40:28.724352 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:28.724326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:40:53.612540 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:53.612500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:53.683083 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:53.683049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:53.741540 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:53.741510 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:40:53.945059 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:40:53.944973 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:43:59.793323 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:43:59.793289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:44:04.792910 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:44:04.792875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:44:05.178656 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:44:05.178584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:45:28.753309 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:45:28.753277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:45:28.753782 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:45:28.753734 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:46:10.866088 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:46:10.866049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:46:15.911379 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:46:15.911340 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:46:16.182545 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:46:16.182458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:48:02.857707 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:48:02.857677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:48:07.870493 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:48:07.870455 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:48:08.000252 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:48:08.000221 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:48:15.541194 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:48:15.541156 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:48:43.994457 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:48:43.994424 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:50:14.297363 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:50:14.297323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:50:19.337595 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:50:19.337556 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:50:19.945136 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:50:19.945099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:50:28.781315 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:50:28.781289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:50:28.782609 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:50:28.782587 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:51:02.370167 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:02.370130 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:06.670176 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:06.670142 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:06.928335 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:06.928252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:41.768692 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:41.768660 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:46.874086 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:46.874051 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:46.949014 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:46.948982 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:47.013702 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:47.013672 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:51:47.605534 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:51:47.605505 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:17.086540 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:17.086506 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:17.183106 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:17.183075 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:22.120779 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:22.120735 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:22.184727 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:22.184690 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:22.532366 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:22.532325 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:53:22.683655 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:53:22.683624 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:54:33.293359 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:54:33.293316 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:54:52.261636 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:54:52.261594 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:55:28.808757 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:55:28.808727 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:55:28.809492 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:55:28.809472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 01:55:50.780392 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:55:50.780343 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:28.699336 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:28.699298 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:28.756738 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:28.756706 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:42.504334 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:42.504297 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:47.584689 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:47.584650 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:47.660256 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:47.660217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:47.940336 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:47.940260 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:56:48.000391 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:56:48.000363 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:58:02.425559 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:58:02.425513 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:58:02.514463 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:58:02.514429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:58:07.776671 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:58:07.776630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:59:37.970022 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:59:37.969990 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:59:42.932204 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:59:42.932170 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:59:43.000158 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:59:43.000126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:59:43.064733 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:59:43.064705 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 01:59:43.217404 ip-10-0-138-146 kubenswrapper[2582]: I0728 01:59:43.217339 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:00:28.834254 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:00:28.834215 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:00:28.836236 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:00:28.836208 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:01:13.035454 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:01:13.035416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:01:14.170298 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:01:14.170265 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:01:18.312886 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:01:18.312851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:01:23.272159 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:01:23.272084 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:01:23.586517 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:01:23.586442 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:02:53.557543 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:02:53.557458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:02:58.637272 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:02:58.637239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:02:59.002558 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:02:59.002525 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:03:33.163873 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:03:33.163840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:04:29.149422 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:04:29.149330 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:04:34.227905 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:04:34.227872 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:04:34.746422 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:04:34.746392 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:05:28.858215 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:05:28.858183 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:05:28.861109 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:05:28.861085 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:07:24.506675 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:24.506583 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:07:29.554511 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:29.554472 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:07:29.692354 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:29.692314 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:07:49.655412 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:49.655377 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:07:54.755483 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:54.755413 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:07:55.021569 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:07:55.021499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:08:44.982512 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:08:44.982473 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:08:50.055517 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:08:50.055455 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:08:50.417478 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:08:50.417396 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:10:10.177813 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:10.177782 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:10:15.244182 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:15.244126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:10:15.804292 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:15.804250 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:10:28.883075 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:28.883006 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:10:28.886752 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:28.886729 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:10:35.430184 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:10:35.430138 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:11:27.061718 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:11:27.061684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:11:32.146475 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:11:32.146430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:11:32.511670 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:11:32.511636 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:12:27.769067 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:12:27.769026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:12:33.863122 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:12:33.863089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:12:38.962144 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:12:38.962107 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:12:39.408256 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:12:39.408215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:13:10.576415 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:13:10.576378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:13:40.872197 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:13:40.872162 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:13:45.955348 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:13:45.955302 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:13:46.134722 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:13:46.134684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:15:16.907551 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:15:16.907515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:15:21.938817 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:15:21.938781 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:15:22.217180 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:15:22.217101 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:15:28.908571 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:15:28.908542 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:15:28.912129 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:15:28.912102 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:16:49.338869 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:16:49.338779 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:16:53.102634 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:16:53.102600 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:16:58.154846 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:16:58.154801 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:16:58.469222 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:16:58.469149 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:18:29.614189 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:18:29.614150 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:18:34.638784 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:18:34.638751 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:18:34.954540 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:18:34.954470 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:18:56.239491 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:18:56.239450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:19.860346 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:19.860304 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:20.105664 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:20.105629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:28.934160 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:28.934129 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:20:28.938786 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:28.938765 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:20:36.606170 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:36.606138 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:36.706978 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:36.706926 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:41.123834 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:41.123799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:42.173337 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:42.173304 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:51.186396 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:51.186364 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:56.347006 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:56.346970 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:20:56.502931 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:20:56.502895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:22:46.584194 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:22:46.584088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:22:51.597760 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:22:51.597721 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:22:51.829822 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:22:51.829789 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:23:08.893398 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:23:08.893362 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:24:21.817240 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:24:21.817209 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:24:26.872690 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:24:26.872654 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:24:27.100629 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:24:27.100582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:25:28.962266 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:25:28.962236 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:25:28.969294 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:25:28.969271 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:25:57.041451 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:25:57.041418 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:26:02.118878 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:26:02.118838 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:26:02.330603 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:26:02.330568 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:27:02.082685 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:27:02.082604 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:27:33.190848 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:27:33.190816 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:27:38.280909 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:27:38.280876 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:27:38.628034 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:27:38.627939 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:29:08.466501 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:29:08.466466 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:29:13.545492 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:29:13.545459 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:29:14.014739 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:29:14.014702 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:29:43.086835 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:29:43.086779 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:28.988663 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:28.988634 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:30:29.000764 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:29.000738 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:30:33.687431 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:33.687387 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:38.799024 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:38.798976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:39.061034 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:39.060939 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:40.904199 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:40.904169 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:45.974046 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:45.973926 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:30:46.192021 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:30:46.191983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:32:16.158790 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:32:16.158751 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:32:21.237078 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:32:21.237031 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:32:21.384361 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:32:21.384326 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:33:21.373179 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:33:21.373145 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:33:26.510281 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:33:26.510248 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:33:26.611450 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:33:26.611416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:33:58.550258 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:33:58.550222 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:34:03.642691 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:34:03.642646 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:34:03.925383 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:34:03.925304 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:34:59.351566 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:34:59.351529 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:35:03.752526 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:35:03.752492 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:35:08.911720 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:35:08.911681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:35:09.432435 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:35:09.432398 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:35:29.013612 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:35:29.013584 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:35:29.032222 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:35:29.032197 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:36:28.193666 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:28.193622 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:28.294383 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:28.294348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:28.565927 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:28.565894 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:28.668509 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:28.668480 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:39.172298 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:39.172263 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:44.237770 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:44.237725 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:36:44.528754 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:36:44.528723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:38:14.485690 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:38:14.485654 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:38:19.560660 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:38:19.560616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:38:19.738140 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:38:19.738092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:01.463292 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:01.463211 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:06.580023 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:06.579986 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:06.965318 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:06.965235 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:47.245063 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:47.245024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:52.343435 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:52.343380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:39:52.411494 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:39:52.411456 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:40:29.046411 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:40:29.046349 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:40:29.058826 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:40:29.058806 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:42:04.822573 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:42:04.822476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:42:09.864289 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:42:09.864249 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:42:09.933818 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:42:09.933783 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:42:37.020846 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:42:37.020816 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:43:26.309843 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:43:26.309749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:43:50.220261 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:43:50.220217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:43:55.280078 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:43:55.280039 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:43:55.471887 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:43:55.471853 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:44:45.366250 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:44:45.366218 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:44:50.492267 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:44:50.492220 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:44:50.754653 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:44:50.754542 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:45:29.070009 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:45:29.069984 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:45:29.084063 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:45:29.084043 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:45:40.656306 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:45:40.656273 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:45:45.722504 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:45:45.722466 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:45:46.074924 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:45:46.074886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:47:05.885424 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:47:05.885381 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:47:10.995515 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:47:10.995476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:47:12.202093 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:47:12.202050 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:48:06.039831 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:48:06.039696 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:48:11.163632 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:48:11.163600 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:48:16.261102 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:48:16.261069 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:48:16.980311 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:48:16.980281 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:49:36.437316 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:49:36.437242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:49:41.544765 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:49:41.544719 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:49:41.734825 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:49:41.734783 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:50:29.094021 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:50:29.093996 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:50:29.109493 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:50:29.109469 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:51:12.807616 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:51:12.807580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:51:12.893398 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:51:12.893361 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:51:14.604944 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:51:14.604903 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:51:58.470700 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:51:58.470661 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:52:41.945907 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:52:41.945828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:52:43.287814 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:52:43.287759 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:52:53.022009 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:52:53.021972 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:52:54.093037 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:52:54.092987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:52:54.268903 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:52:54.268871 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:03.881143 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:03.881103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:24.217052 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:24.217021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:25.286748 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:25.286713 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:25.404146 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:25.404107 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:35.271943 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:35.271910 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:36.355322 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:36.355293 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:54:36.564105 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:54:36.564076 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:55:29.121899 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:55:29.121871 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:55:29.137003 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:55:29.136979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:56:06.503272 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:06.503234 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:07.490259 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:07.490226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:07.670562 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:07.670516 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:17.555779 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:17.555748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:19.572620 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:19.572580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:19.667269 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:19.667242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:53.469704 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:53.469560 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:53.619930 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:53.619889 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:53.686763 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:53.686732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:56.387873 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:56.387832 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vzz62_b8a4c694-c114-4bcf-8628-ae43f2540b74/global-pull-secret-syncer/0.log" Jul 28 02:56:56.458290 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:56.458262 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" Jul 28 02:56:56.601319 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:56.601292 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-146.ec2.internal_7de2163f97d96577b1944d1e86114197/haproxy/0.log" Jul 28 02:56:59.176726 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:59.176687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:56:59.247173 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:56:59.247134 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d7f6c_620b65eb-14e4-41d2-b7f0-06680ca829d9/konnectivity-agent/0.log" limit=1024 Jul 28 02:57:00.383257 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:00.383228 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-4fgpl_4921e80c-64c6-48e8-a9f3-cc3ac02f93ce/cluster-monitoring-operator/0.log" Jul 28 02:57:00.696411 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:00.696344 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frfzj_e878053a-8c7b-4523-988b-153d2ec216b0/node-exporter/0.log" Jul 28 02:57:00.725295 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:00.725276 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frfzj_e878053a-8c7b-4523-988b-153d2ec216b0/kube-rbac-proxy/0.log" Jul 28 02:57:00.758418 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:00.758395 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frfzj_e878053a-8c7b-4523-988b-153d2ec216b0/init-textfile/0.log" Jul 28 02:57:02.926193 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:02.926159 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-vk8v4_81c8d2d8-d0ef-413c-bed5-17213ef94469/networking-console-plugin/0.log" Jul 28 02:57:03.543413 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:03.543368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/1.log" Jul 28 02:57:03.553071 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:03.553043 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2wjmp_ca2d7844-c1fc-4899-b726-76074d454c92/console-operator/2.log" Jul 28 02:57:03.982792 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:03.982709 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668d4bffdc-5wvf6_99df4e62-4120-4b00-a989-0ba200b94950/console/0.log" Jul 28 02:57:04.539930 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:04.539894 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-w2l2l_6d61c0d9-918f-4899-abe2-8825abb20398/volume-data-source-validator/0.log" Jul 28 02:57:05.181355 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.181322 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn"] Jul 28 02:57:05.184874 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.184849 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.187808 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.187784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxmf9\"/\"kube-root-ca.crt\"" Jul 28 02:57:05.187931 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.187784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxmf9\"/\"default-dockercfg-rxfnb\"" Jul 28 02:57:05.188511 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.188487 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxmf9\"/\"openshift-service-ca.crt\"" Jul 28 02:57:05.196828 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.196806 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn"] Jul 28 02:57:05.235828 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.235802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-lib-modules\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.235993 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.235837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-sys\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.235993 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.235873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n789\" (UniqueName: \"kubernetes.io/projected/cca7131a-0eaf-4a01-b008-45dab4c55eb1-kube-api-access-6n789\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.236122 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.235995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-proc\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.236122 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.236033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-podres\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.336845 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.336816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-proc\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337001 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.336849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-podres\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337001 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.336884 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-lib-modules\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337001 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.336904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-sys\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337001 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.336979 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-proc\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337190 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.337011 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-sys\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337190 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.337034 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n789\" (UniqueName: \"kubernetes.io/projected/cca7131a-0eaf-4a01-b008-45dab4c55eb1-kube-api-access-6n789\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337190 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.337043 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-podres\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.337190 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.337081 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cca7131a-0eaf-4a01-b008-45dab4c55eb1-lib-modules\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.346032 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.346008 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n789\" (UniqueName: \"kubernetes.io/projected/cca7131a-0eaf-4a01-b008-45dab4c55eb1-kube-api-access-6n789\") pod \"perf-node-gather-daemonset-bszzn\" (UID: \"cca7131a-0eaf-4a01-b008-45dab4c55eb1\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.443241 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.443186 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5jgcm_fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea/dns/0.log" Jul 28 02:57:05.465280 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.465263 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5jgcm_fc0e634c-36ba-4d3c-93b3-374ffd3fb4ea/kube-rbac-proxy/0.log" Jul 28 02:57:05.496333 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.496316 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:05.627460 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.627431 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn"] Jul 28 02:57:05.630431 ip-10-0-138-146 kubenswrapper[2582]: W0728 02:57:05.630404 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcca7131a_0eaf_4a01_b008_45dab4c55eb1.slice/crio-b84f2965a1c642b2beec373b7fbf874b6676200c9ea05ba1cc610d369f641325 WatchSource:0}: Error finding container b84f2965a1c642b2beec373b7fbf874b6676200c9ea05ba1cc610d369f641325: Status 404 returned error can't find the container with id b84f2965a1c642b2beec373b7fbf874b6676200c9ea05ba1cc610d369f641325 Jul 28 02:57:05.645806 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:05.645790 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wj5md_64665e99-9108-4365-aa0f-4325cc8cbe18/dns-node-resolver/0.log" Jul 28 02:57:06.011631 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.011593 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" event={"ID":"cca7131a-0eaf-4a01-b008-45dab4c55eb1","Type":"ContainerStarted","Data":"294b9c0744d28dd354d532b99831984ad1df9d7f1b540f61368cefac5831f1fe"} Jul 28 02:57:06.011752 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.011692 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" event={"ID":"cca7131a-0eaf-4a01-b008-45dab4c55eb1","Type":"ContainerStarted","Data":"b84f2965a1c642b2beec373b7fbf874b6676200c9ea05ba1cc610d369f641325"} Jul 28 02:57:06.011752 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.011724 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:06.027651 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.027608 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" podStartSLOduration=1.027593307 podStartE2EDuration="1.027593307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:57:06.026445395 +0000 UTC m=+5497.782275909" watchObservedRunningTime="2026-07-28 02:57:06.027593307 +0000 UTC m=+5497.783423820" Jul 28 02:57:06.207230 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.207204 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44zng_ccede81a-d0c8-4075-8d79-0fc727895039/node-ca/0.log" Jul 28 02:57:06.981842 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:06.981815 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb96f565-48h9w_bb9613e0-54d6-4f74-be9b-971130eb0aeb/router/0.log" Jul 28 02:57:07.362294 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.362249 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsp9t_5df042c8-7d55-4d9e-a957-88d9d619d288/serve-healthcheck-canary/0.log" Jul 28 02:57:07.723750 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.723668 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-v56ph_6227d146-0d15-456b-8d7d-566c35322667/insights-operator/0.log" Jul 28 02:57:07.727921 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.727898 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-v56ph_6227d146-0d15-456b-8d7d-566c35322667/insights-operator/1.log" Jul 28 02:57:07.817823 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.817803 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lxh66_6eb0fd49-2cef-4609-8b9c-aa0dc634fd53/kube-rbac-proxy/0.log" Jul 28 02:57:07.840011 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.839986 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lxh66_6eb0fd49-2cef-4609-8b9c-aa0dc634fd53/exporter/0.log" Jul 28 02:57:07.863904 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:07.863881 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lxh66_6eb0fd49-2cef-4609-8b9c-aa0dc634fd53/extractor/0.log" Jul 28 02:57:10.285149 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:10.285120 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-ff96d5959-g58wx_5b78b6ca-a366-4845-964e-89a6f4d5a552/manager/0.log" Jul 28 02:57:10.320159 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:10.320129 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-4bbbl_2eb9065d-4975-4d79-8807-a1d254849d8c/manager/0.log" Jul 28 02:57:10.821672 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:10.821645 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-rfxrz_6dc99ce5-9e7b-4ef3-87b9-1ed32db9b631/seaweedfs/0.log" Jul 28 02:57:10.845989 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:10.845947 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-hkqvf_27ec484e-20b3-42bc-a49a-43e1ce12c56a/seaweedfs-tls-custom/0.log" Jul 28 02:57:10.870875 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:10.870857 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-jk8pt_73c0b40d-5ab6-4400-b6b9-51fce1c9396c/seaweedfs-tls-serving/0.log" Jul 28 02:57:12.026914 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:12.026874 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-bszzn" Jul 28 02:57:15.231007 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:15.230922 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z9568_8eb31a5b-4d6c-48ef-ac20-ce0d12b58965/kube-storage-version-migrator-operator/1.log" Jul 28 02:57:15.232709 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:15.232675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z9568_8eb31a5b-4d6c-48ef-ac20-ce0d12b58965/kube-storage-version-migrator-operator/0.log" Jul 28 02:57:16.182939 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.182915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/kube-multus-additional-cni-plugins/0.log" Jul 28 02:57:16.208971 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.206717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/egress-router-binary-copy/0.log" Jul 28 02:57:16.229545 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.229517 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/cni-plugins/0.log" Jul 28 02:57:16.253170 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.253148 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/bond-cni-plugin/0.log" Jul 28 02:57:16.275745 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.275719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/routeoverride-cni/0.log" Jul 28 02:57:16.296184 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.296163 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/whereabouts-cni-bincopy/0.log" Jul 28 02:57:16.318062 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.318034 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hbx5_880c37b5-d95f-469e-ad50-c7d0d4856ce1/whereabouts-cni/0.log" Jul 28 02:57:16.786049 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.785893 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhz2n_38a8bcee-a987-4016-8975-d8f0d090f483/kube-multus/0.log" Jul 28 02:57:16.839171 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.839137 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bncwf_ce6f34af-1c37-47de-aa81-52b6b42a3795/network-metrics-daemon/0.log" Jul 28 02:57:16.860364 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:16.860343 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bncwf_ce6f34af-1c37-47de-aa81-52b6b42a3795/kube-rbac-proxy/0.log" Jul 28 02:57:17.722854 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.722827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/ovn-controller/0.log" Jul 28 02:57:17.740938 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.740917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/ovn-acl-logging/0.log" Jul 28 02:57:17.767501 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.767477 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/kube-rbac-proxy-node/0.log" Jul 28 02:57:17.789567 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.789545 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 02:57:17.809209 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.809190 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/northd/0.log" Jul 28 02:57:17.831466 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.831445 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/nbdb/0.log" Jul 28 02:57:17.856448 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.856420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/sbdb/0.log" Jul 28 02:57:17.924251 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:17.924222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29fkx_dc880e44-66fc-4122-99ee-a232d15fcae0/ovnkube-controller/0.log" Jul 28 02:57:19.343677 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:19.343652 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-jnxqv_f5a01e74-8484-421d-9c8b-75f2349a377c/check-endpoints/0.log" Jul 28 02:57:19.395056 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:19.395024 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jnfwc_bdbffc66-38e4-49b5-81c5-abca4a6e5b95/network-check-target-container/0.log" Jul 28 02:57:20.373330 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:20.373298 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-r6mj8_b86b2dc3-6dbe-4b4e-8b4f-eab0c42c5f8e/iptables-alerter/0.log" Jul 28 02:57:21.019946 ip-10-0-138-146 kubenswrapper[2582]: I0728 02:57:21.019920 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nzgsc_d5c99969-e97a-4b0b-a501-35177279e3d2/tuned/0.log"