May 21 11:42:45.121141 ip-10-0-128-31 systemd[1]: Starting Kubernetes Kubelet... May 21 11:42:45.598667 ip-10-0-128-31 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:42:45.598667 ip-10-0-128-31 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 11:42:45.598667 ip-10-0-128-31 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:42:45.598667 ip-10-0-128-31 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 11:42:45.598667 ip-10-0-128-31 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:42:45.599525 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.599431 2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 11:42:45.604354 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604339 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:42:45.604354 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604353 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604357 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604362 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604366 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604369 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604372 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604375 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604379 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604382 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604384 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604387 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604390 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604393 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604395 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604400 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604404 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604407 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604410 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604413 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:42:45.604434 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604417 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604420 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604422 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604425 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604428 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604431 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604435 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604438 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604442 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604445 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604447 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604450 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604453 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604455 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604459 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604461 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604464 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604466 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604469 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604471 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:42:45.604903 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604474 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604477 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604479 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604483 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604485 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604488 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604490 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604493 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604495 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604498 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604501 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604504 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604506 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604508 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604512 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604515 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604518 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604521 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604524 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604527 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:42:45.605386 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604530 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604533 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604535 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604538 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604540 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604543 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604546 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604548 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604551 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604553 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604557 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604560 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604562 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604565 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604567 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604570 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604572 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604575 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604577 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:42:45.605874 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604580 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604582 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604585 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604587 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604590 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604593 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.604596 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605006 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605012 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605014 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605017 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605020 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605023 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605025 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605028 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605030 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605033 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605036 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605039 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605042 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:42:45.606370 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605045 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605047 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605050 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605053 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605055 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605057 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605060 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605063 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605065 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605069 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605072 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605075 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605077 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605080 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605082 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605085 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605087 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605090 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605093 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:42:45.606866 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605097 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605099 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605102 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605104 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605107 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605110 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605113 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605115 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605118 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605120 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605123 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605126 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605128 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605131 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605134 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605136 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605140 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605143 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605146 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:42:45.607342 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605149 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605152 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605155 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605158 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605161 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605163 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605166 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605168 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605171 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605173 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605176 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605178 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605181 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605185 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605188 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605191 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605194 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605196 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605199 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605201 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:42:45.607805 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605204 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605206 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605209 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605211 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605214 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605216 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605218 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605227 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605229 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605232 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605234 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605236 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605239 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605241 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.605244 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606819 2557 flags.go:64] FLAG: --address="0.0.0.0" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606833 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606841 2557 flags.go:64] FLAG: --anonymous-auth="true" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606846 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606850 2557 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606853 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 11:42:45.608303 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606871 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606875 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606879 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606882 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606886 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606889 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606893 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606896 2557 flags.go:64] FLAG: --cgroup-root="" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606899 2557 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606902 2557 flags.go:64] FLAG: --client-ca-file="" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606905 2557 flags.go:64] FLAG: --cloud-config="" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606908 2557 flags.go:64] FLAG: --cloud-provider="external" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606911 2557 flags.go:64] FLAG: --cluster-dns="[]" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606914 2557 flags.go:64] FLAG: --cluster-domain="" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606917 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606920 2557 flags.go:64] FLAG: --config-dir="" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606923 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606926 2557 flags.go:64] FLAG: --container-log-max-files="5" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606930 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606934 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606937 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606941 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606944 2557 flags.go:64] FLAG: --contention-profiling="false" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606947 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 11:42:45.608809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606950 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606954 2557 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606957 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606961 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606964 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606966 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606969 2557 flags.go:64] FLAG: --enable-load-reader="false" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606972 2557 flags.go:64] FLAG: --enable-server="true" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606975 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606980 2557 flags.go:64] FLAG: --event-burst="100" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606983 2557 flags.go:64] FLAG: --event-qps="50" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606986 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606990 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606993 2557 flags.go:64] FLAG: --eviction-hard="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606996 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.606999 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607003 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607006 2557 flags.go:64] FLAG: --eviction-soft="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607009 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607012 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607015 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607018 2557 flags.go:64] FLAG: --experimental-mounter-path="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607021 2557 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607024 2557 flags.go:64] FLAG: --fail-swap-on="true" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607027 2557 flags.go:64] FLAG: --feature-gates="" May 21 11:42:45.609491 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607031 2557 flags.go:64] FLAG: --file-check-frequency="20s" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607034 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607037 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607041 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607044 2557 flags.go:64] FLAG: --healthz-port="10248" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607047 2557 flags.go:64] FLAG: --help="false" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607050 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-128-31.ec2.internal" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607053 2557 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607057 2557 flags.go:64] FLAG: --http-check-frequency="20s" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607059 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607063 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607066 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607069 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607075 2557 flags.go:64] FLAG: --image-service-endpoint="" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607078 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607081 2557 flags.go:64] FLAG: --kube-api-burst="100" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607084 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607088 2557 flags.go:64] FLAG: --kube-api-qps="50" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607091 2557 flags.go:64] FLAG: --kube-reserved="" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607094 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607097 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607101 2557 flags.go:64] FLAG: --kubelet-cgroups="" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607104 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607107 2557 flags.go:64] FLAG: --lock-file="" May 21 11:42:45.610138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607110 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607113 2557 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607116 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607122 2557 flags.go:64] FLAG: --log-json-split-stream="false" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607125 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607127 2557 flags.go:64] FLAG: --log-text-split-stream="false" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607130 2557 flags.go:64] FLAG: --logging-format="text" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607133 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607137 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607140 2557 flags.go:64] FLAG: --manifest-url="" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607143 2557 flags.go:64] FLAG: --manifest-url-header="" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607147 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607156 2557 flags.go:64] FLAG: --max-open-files="1000000" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607160 2557 flags.go:64] FLAG: --max-pods="110" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607163 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607166 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607169 2557 flags.go:64] FLAG: --memory-manager-policy="None" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607172 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607175 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607178 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607181 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607188 2557 flags.go:64] FLAG: --node-status-max-images="50" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607191 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607194 2557 flags.go:64] FLAG: --oom-score-adj="-999" May 21 11:42:45.610737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607198 2557 flags.go:64] FLAG: --pod-cidr="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607201 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607207 2557 flags.go:64] FLAG: --pod-manifest-path="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607210 2557 flags.go:64] FLAG: --pod-max-pids="-1" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607214 2557 flags.go:64] FLAG: --pods-per-core="0" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607217 2557 flags.go:64] FLAG: --port="10250" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607220 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607223 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035c70ae0ae3a48d9" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607226 2557 flags.go:64] FLAG: --qos-reserved="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607229 2557 flags.go:64] FLAG: --read-only-port="10255" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607232 2557 flags.go:64] FLAG: --register-node="true" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607235 2557 flags.go:64] FLAG: --register-schedulable="true" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607238 2557 flags.go:64] FLAG: --register-with-taints="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607242 2557 flags.go:64] FLAG: --registry-burst="10" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607245 2557 flags.go:64] FLAG: --registry-qps="5" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607248 2557 flags.go:64] FLAG: --reserved-cpus="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607251 2557 flags.go:64] FLAG: --reserved-memory="" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607255 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607258 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607261 2557 flags.go:64] FLAG: --rotate-certificates="false" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607264 2557 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607270 2557 flags.go:64] FLAG: --runonce="false" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607273 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607277 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607280 2557 flags.go:64] FLAG: --seccomp-default="false" May 21 11:42:45.611354 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607283 2557 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607286 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607289 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607292 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607295 2557 flags.go:64] FLAG: --storage-driver-password="root" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607298 2557 flags.go:64] FLAG: --storage-driver-secure="false" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607301 2557 flags.go:64] FLAG: --storage-driver-table="stats" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607304 2557 flags.go:64] FLAG: --storage-driver-user="root" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607307 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607310 2557 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607315 2557 flags.go:64] FLAG: --system-cgroups="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607318 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607324 2557 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607327 2557 flags.go:64] FLAG: --tls-cert-file="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607330 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607334 2557 flags.go:64] FLAG: --tls-min-version="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607337 2557 flags.go:64] FLAG: --tls-private-key-file="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607340 2557 flags.go:64] FLAG: --topology-manager-policy="none" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607343 2557 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607346 2557 flags.go:64] FLAG: --topology-manager-scope="container" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607349 2557 flags.go:64] FLAG: --v="2" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607353 2557 flags.go:64] FLAG: --version="false" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607358 2557 flags.go:64] FLAG: --vmodule="" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607362 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.607365 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 11:42:45.611965 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607462 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607466 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607469 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607471 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607474 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607476 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607479 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607482 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607485 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607487 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607490 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607493 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607495 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607498 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607500 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607503 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607508 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607513 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607516 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:42:45.612555 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607519 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607522 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607525 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607528 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607530 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607533 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607535 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607538 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607541 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607544 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607547 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607549 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607551 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607555 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607557 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607560 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607563 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607566 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607569 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607572 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:42:45.613028 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607574 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607577 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607579 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607582 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607584 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607587 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607589 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607591 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607596 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607599 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607605 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607607 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607610 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607612 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607615 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607618 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607620 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607623 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607625 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:42:45.613529 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607628 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607630 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607633 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607635 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607638 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607640 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607643 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607645 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607648 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607650 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607652 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607655 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607658 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607660 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607663 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607665 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607668 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607670 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607673 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607675 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:42:45.614032 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607678 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607682 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607685 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607689 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607691 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607694 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607696 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.607699 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:42:45.614519 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.608530 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:42:45.615397 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.615379 2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 11:42:45.615434 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.615398 2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 11:42:45.615464 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615453 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:42:45.615464 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615458 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:42:45.615464 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615461 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:42:45.615464 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615464 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615467 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615470 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615473 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615476 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615478 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615481 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615484 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615487 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615490 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615492 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615495 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615497 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615500 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615503 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615505 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615508 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615512 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615514 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615517 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:42:45.615564 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615520 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615522 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615524 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615527 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615530 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615534 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615538 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615540 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615549 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615552 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615556 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615560 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615564 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615567 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615570 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615573 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615576 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615579 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615582 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:42:45.616061 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615584 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615587 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615589 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615592 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615595 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615597 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615600 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615602 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615604 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615607 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615609 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615612 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615615 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615617 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615620 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615624 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615626 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615629 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615631 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615634 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:42:45.616535 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615636 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615639 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615647 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615650 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615652 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615655 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615657 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615660 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615662 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615665 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615668 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615671 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615674 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615677 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615679 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615682 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615684 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615687 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615689 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615692 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:42:45.617027 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615694 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615697 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615699 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615702 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.615707 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615843 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615848 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615851 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615854 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615870 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615875 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615878 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615881 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615883 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615886 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:42:45.617519 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615894 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615897 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615900 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615903 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615905 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615908 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615911 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615913 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615916 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615918 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615921 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615923 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615926 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615928 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615931 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615933 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615936 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615938 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615941 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615943 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:42:45.617917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615946 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615948 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615951 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615953 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615956 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615959 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615961 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615964 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615967 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615969 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615971 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615974 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615976 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615985 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615987 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615990 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615992 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615994 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.615997 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:42:45.618402 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616000 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616002 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616004 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616007 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616009 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616012 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616014 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616016 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616019 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616021 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616024 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616026 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616029 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616032 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616034 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616037 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616039 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616044 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616047 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:42:45.618916 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616051 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616053 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616056 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616059 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616062 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616065 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616068 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616071 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616080 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616083 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616086 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616088 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616091 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616093 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616096 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616098 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616101 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:42:45.619371 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:45.616103 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:42:45.619870 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.616108 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:42:45.619870 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.617040 2557 server.go:962] "Client rotation is on, will bootstrap in background" May 21 11:42:45.619870 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.619427 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 11:42:45.620939 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.620927 2557 server.go:1019] "Starting client certificate rotation" May 21 11:42:45.621071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.621046 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 11:42:45.621130 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.621101 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 11:42:45.650322 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.650295 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 11:42:45.655781 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.655756 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 11:42:45.677210 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.677176 2557 log.go:25] "Validated CRI v1 runtime API" May 21 11:42:45.683522 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.683501 2557 log.go:25] "Validated CRI v1 image API" May 21 11:42:45.686161 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.686139 2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 11:42:45.688702 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.688685 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 11:42:45.696595 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.696570 2557 fs.go:135] Filesystem UUIDs: map[433f009e-d444-474d-bb58-2b7421033c19:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f67f8693-7a1f-4c25-bccd-4efe569ac556:/dev/nvme0n1p4] May 21 11:42:45.696653 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.696596 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 11:42:45.700955 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.700833 2557 manager.go:217] Machine: {Timestamp:2026-05-21 11:42:45.700321395 +0000 UTC m=+0.464953357 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100655 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec236c4862fd7e94dabc689e066b029b SystemUUID:ec236c48-62fd-7e94-dabc-689e066b029b BootID:f153c2ec-ec0b-410a-8d17-1cf476e309a7 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:7e:97:02:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:7e:97:02:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:13:49:f6:b0:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 11:42:45.701799 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.701788 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 11:42:45.701900 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.701888 2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 11:42:45.703953 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.703926 2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 11:42:45.704102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.703956 2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 11:42:45.704150 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.704114 2557 topology_manager.go:138] "Creating topology manager with none policy" May 21 11:42:45.704150 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.704123 2557 container_manager_linux.go:306] "Creating device plugin manager" May 21 11:42:45.704150 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.704130 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 11:42:45.704962 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.704951 2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 11:42:45.706644 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.706634 2557 state_mem.go:36] "Initialized new in-memory state store" May 21 11:42:45.706805 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.706796 2557 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 11:42:45.710063 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.710053 2557 kubelet.go:491] "Attempting to sync node with API server" May 21 11:42:45.710106 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.710072 2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 11:42:45.710106 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.710085 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 11:42:45.710106 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.710095 2557 kubelet.go:397] "Adding apiserver pod source" May 21 11:42:45.710106 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.710104 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 11:42:45.711280 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.711267 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 11:42:45.711336 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.711287 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 11:42:45.714737 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.714721 2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 11:42:45.718034 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.718020 2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 11:42:45.720010 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.719996 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720016 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720022 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720027 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720036 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720049 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720058 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 11:42:45.720071 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720071 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 11:42:45.720245 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720078 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 11:42:45.720245 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720084 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 11:42:45.720245 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720096 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 11:42:45.720245 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.720101 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 11:42:45.721384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.721374 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 11:42:45.721384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.721383 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 11:42:45.724690 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.724667 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 11:42:45.724690 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.724685 2557 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 11:42:45.724690 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.724675 2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 11:42:45.724902 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.724720 2557 server.go:1295] "Started kubelet" May 21 11:42:45.724902 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.724736 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 11:42:45.725598 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.724809 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 11:42:45.725667 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.724800 2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 11:42:45.725667 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.725643 2557 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 11:42:45.726364 ip-10-0-128-31 systemd[1]: Started Kubernetes Kubelet. May 21 11:42:45.727768 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.727747 2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 11:42:45.728753 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.728741 2557 server.go:317] "Adding debug handlers to kubelet server" May 21 11:42:45.734773 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.734752 2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 11:42:45.737408 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737393 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 11:42:45.737490 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737395 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 11:42:45.737554 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737531 2557 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 11:42:45.737554 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737543 2557 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 11:42:45.737659 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737647 2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 11:42:45.737708 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737703 2557 reconstruct.go:97] "Volume reconstruction finished" May 21 11:42:45.737750 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.737712 2557 reconciler.go:26] "Reconciler: start to sync state" May 21 11:42:45.738485 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.738466 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:45.738573 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738505 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 11:42:45.738573 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738521 2557 factory.go:55] Registering systemd factory May 21 11:42:45.738573 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738531 2557 factory.go:223] Registration of the systemd container factory successfully May 21 11:42:45.738872 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738844 2557 factory.go:153] Registering CRI-O factory May 21 11:42:45.738958 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738877 2557 factory.go:223] Registration of the crio container factory successfully May 21 11:42:45.738958 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738894 2557 factory.go:103] Registering Raw factory May 21 11:42:45.738958 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.738908 2557 manager.go:1196] Started watching for new ooms in manager May 21 11:42:45.739544 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.739526 2557 manager.go:319] Starting recovery of all containers May 21 11:42:45.742814 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.742784 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 11:42:45.743071 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.743047 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 11:42:45.743913 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.742770 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-31.ec2.internal.18b191eade38cd33 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-31.ec2.internal,UID:ip-10-0-128-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-31.ec2.internal,},FirstTimestamp:2026-05-21 11:42:45.724695859 +0000 UTC m=+0.489327821,LastTimestamp:2026-05-21 11:42:45.724695859 +0000 UTC m=+0.489327821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-31.ec2.internal,}" May 21 11:42:45.744508 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.744486 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mbhbt" May 21 11:42:45.749769 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.749654 2557 manager.go:324] Recovery completed May 21 11:42:45.752780 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.752761 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mbhbt" May 21 11:42:45.753998 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.753982 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.756405 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.756385 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.756481 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.756420 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.756481 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.756435 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:45.756996 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.756981 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 11:42:45.756996 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.756993 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 11:42:45.757116 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.757009 2557 state_mem.go:36] "Initialized new in-memory state store" May 21 11:42:45.758137 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.758069 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-31.ec2.internal.18b191eae01ca950 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-31.ec2.internal,UID:ip-10-0-128-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-31.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-31.ec2.internal,},FirstTimestamp:2026-05-21 11:42:45.756406096 +0000 UTC m=+0.521038065,LastTimestamp:2026-05-21 11:42:45.756406096 +0000 UTC m=+0.521038065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-31.ec2.internal,}" May 21 11:42:45.761102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.761089 2557 policy_none.go:49] "None policy: Start" May 21 11:42:45.761179 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.761107 2557 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 11:42:45.761179 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.761118 2557 state_mem.go:35] "Initializing new in-memory state store" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801418 2557 manager.go:341] "Starting Device Plugin manager" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.801451 2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801462 2557 server.go:85] "Starting device plugin registration server" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801736 2557 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801753 2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801874 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801965 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.801976 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.802816 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 11:42:45.817421 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.802881 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:45.867047 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.867009 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 11:42:45.868271 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.868250 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 11:42:45.868271 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.868274 2557 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 11:42:45.868425 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.868294 2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 11:42:45.868425 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.868300 2557 kubelet.go:2451] "Starting kubelet main sync loop" May 21 11:42:45.868425 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.868335 2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 11:42:45.871053 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.871035 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:42:45.902161 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.902127 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.903477 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.903461 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.903564 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.903490 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.903564 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.903501 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:45.903564 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.903526 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-31.ec2.internal" May 21 11:42:45.914282 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.914264 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-31.ec2.internal" May 21 11:42:45.914333 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.914286 2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-31.ec2.internal\": node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:45.924936 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:45.924917 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:45.968582 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.968550 2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"] May 21 11:42:45.968674 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.968622 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.969651 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.969636 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.969726 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.969664 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.969726 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.969674 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:45.972055 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972043 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.972216 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972199 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:45.972251 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972234 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.972746 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972731 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.972793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972760 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.972793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972772 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:45.972793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972731 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.972917 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972808 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.972917 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.972823 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:45.975060 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.975045 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:45.975124 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.975071 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:42:45.975806 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.975788 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory" May 21 11:42:45.975895 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.975815 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:42:45.975895 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:45.975824 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID" May 21 11:42:46.002399 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.002377 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-31.ec2.internal\" not found" node="ip-10-0-128-31.ec2.internal" May 21 11:42:46.006587 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.006572 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-31.ec2.internal\" not found" node="ip-10-0-128-31.ec2.internal" May 21 11:42:46.025978 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.025959 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.039023 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.038999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.127076 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.126984 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.139305 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.139280 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.139392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.139315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.139392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.139334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90aca22efb10402ecfb9f75795df2729-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"90aca22efb10402ecfb9f75795df2729\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:46.139392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.139373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.227693 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.227635 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.239922 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.239903 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.240029 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.239928 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90aca22efb10402ecfb9f75795df2729-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"90aca22efb10402ecfb9f75795df2729\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:46.240029 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.239970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90aca22efb10402ecfb9f75795df2729-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"90aca22efb10402ecfb9f75795df2729\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:46.240029 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.239988 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb38f211b718540000930af38b651a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"cdb38f211b718540000930af38b651a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.305084 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.305041 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.309461 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.309443 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:46.328112 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.328077 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.428707 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.428603 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.529164 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.529126 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.619805 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.619780 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 11:42:46.620385 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.619923 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 11:42:46.620385 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.619920 2557 request.go:1360] "Unexpected error when reading response body" err="read tcp 10.0.128.31:39624->54.88.233.87:6443: use of closed network connection" May 21 11:42:46.620385 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.620003 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.128.31:39624->54.88.233.87:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 11:42:46.629624 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.629604 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.636416 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.636393 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:42:46.730149 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.730105 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.738140 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.738111 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 11:42:46.751591 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.751566 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 11:42:46.755718 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.755689 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 11:37:45 +0000 UTC" deadline="2028-02-28 15:09:12.163567062 +0000 UTC" May 21 11:42:46.755718 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.755714 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15555h26m25.407855361s" May 21 11:42:46.772259 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.772233 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zkz85" May 21 11:42:46.780982 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.780962 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zkz85" May 21 11:42:46.830651 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:46.830621 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found" May 21 11:42:46.843485 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:46.843451 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90aca22efb10402ecfb9f75795df2729.slice/crio-e273612bceb23082b5eca59f61cfbd8dff1557e3f83eddcfcdd4828177fbca19 WatchSource:0}: Error finding container e273612bceb23082b5eca59f61cfbd8dff1557e3f83eddcfcdd4828177fbca19: Status 404 returned error can't find the container with id e273612bceb23082b5eca59f61cfbd8dff1557e3f83eddcfcdd4828177fbca19 May 21 11:42:46.843691 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.843673 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:42:46.843743 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:46.843710 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb38f211b718540000930af38b651a0.slice/crio-04e61feafa1ccf6cb0ec1c38435ed5bf64bf785fed8d37a144c6491d1085dd07 WatchSource:0}: Error finding container 04e61feafa1ccf6cb0ec1c38435ed5bf64bf785fed8d37a144c6491d1085dd07: Status 404 returned error can't find the container with id 04e61feafa1ccf6cb0ec1c38435ed5bf64bf785fed8d37a144c6491d1085dd07 May 21 11:42:46.847076 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.847059 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:42:46.870900 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.870827 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"cdb38f211b718540000930af38b651a0","Type":"ContainerStarted","Data":"04e61feafa1ccf6cb0ec1c38435ed5bf64bf785fed8d37a144c6491d1085dd07"} May 21 11:42:46.871627 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.871607 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" event={"ID":"90aca22efb10402ecfb9f75795df2729","Type":"ContainerStarted","Data":"e273612bceb23082b5eca59f61cfbd8dff1557e3f83eddcfcdd4828177fbca19"} May 21 11:42:46.938799 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.938774 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" May 21 11:42:46.953362 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.953342 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 11:42:46.955088 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.955075 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" May 21 11:42:46.963889 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:46.963868 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 11:42:47.643474 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.643447 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:42:47.711811 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.711779 2557 apiserver.go:52] "Watching apiserver" May 21 11:42:47.721426 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.721393 2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 11:42:47.721837 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.721802 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-5l2w9","kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44","openshift-cluster-node-tuning-operator/tuned-rjmr8","openshift-image-registry/node-ca-tlkjf","openshift-multus/multus-additional-cni-plugins-fm9pn","openshift-multus/multus-plmwv","openshift-network-diagnostics/network-check-target-mbws8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal","openshift-multus/network-metrics-daemon-znxqq","openshift-network-operator/iptables-alerter-ncbxg","openshift-ovn-kubernetes/ovnkube-node-q4hxb"] May 21 11:42:47.724320 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.724294 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.726507 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.726477 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.727307 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.727148 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 11:42:47.727307 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.727183 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 11:42:47.727307 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.727220 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-stfbh\"" May 21 11:42:47.728719 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.728674 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-plmwv" May 21 11:42:47.729026 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.728999 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 11:42:47.729026 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.729022 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7lpb\"" May 21 11:42:47.729184 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.729026 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 11:42:47.729277 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.729259 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 11:42:47.729340 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.729281 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 11:42:47.729340 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.729290 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 11:42:47.731096 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.730922 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.731096 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.730999 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:47.731096 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.731031 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9n5sq\"" May 21 11:42:47.731096 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.731046 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 11:42:47.733151 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.733133 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.735413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.735397 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.735500 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.735488 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 11:42:47.735580 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.735565 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 11:42:47.735843 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.735772 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ntj5r\"" May 21 11:42:47.737746 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.737704 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.737837 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.737783 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 11:42:47.738197 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.738179 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 11:42:47.738406 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.738347 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-szns8\"" May 21 11:42:47.738406 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.738379 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 11:42:47.740390 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.740374 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 11:42:47.740481 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.740374 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 11:42:47.740853 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.740832 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r5dxp\"" May 21 11:42:47.741085 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.741065 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 11:42:47.742047 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.741884 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:47.742047 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.741975 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:47.744373 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.744209 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.747308 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747290 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747614 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cec6820b-7195-437d-8572-59ffea1ba1b7-serviceca\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-kubernetes\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-cnibin\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqb6\" (UniqueName: \"kubernetes.io/projected/e3392d96-9470-4af6-93fa-3f63dc600c6a-kube-api-access-xxqb6\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-conf\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-tuned\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747818 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747827 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4j9m4\"" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747830 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-system-cni-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747924 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747942 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-netns\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.747972 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-run\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.747996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-lib-modules\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-registration-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgx2m\" (UniqueName: \"kubernetes.io/projected/f56fb641-79ba-4785-8b20-ee531cdbb21a-kube-api-access-sgx2m\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr49w\" (UniqueName: \"kubernetes.io/projected/cec6820b-7195-437d-8572-59ffea1ba1b7-kube-api-access-lr49w\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748140 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-cnibin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-agent-certs\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748302 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-host\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-tmp\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-os-release\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-k8s-cni-cncf-io\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-multus-certs\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.748732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-systemd\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccdch\" (UniqueName: \"kubernetes.io/projected/08beb4c2-4188-450b-b813-6f96a06a837c-kube-api-access-ccdch\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-sys-fs\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cec6820b-7195-437d-8572-59ffea1ba1b7-host\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-modprobe-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-system-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748703 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-socket-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748761 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-device-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748793 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-konnectivity-ca\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748852 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.748996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-etc-kubernetes\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749022 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-cni-binary-copy\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-daemon-config\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysconfig\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.749447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-bin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-conf-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfnt\" (UniqueName: \"kubernetes.io/projected/e3b6b942-eb89-4c90-a056-f739da1a88c5-kube-api-access-8sfnt\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749193 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-os-release\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749216 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-socket-dir-parent\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749279 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-sys\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-var-lib-kubelet\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749358 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-multus\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-kubelet\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-hostroot\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z427d\" (UniqueName: \"kubernetes.io/projected/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-kube-api-access-z427d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749887 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 11:42:47.750148 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.749969 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 11:42:47.751209 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.751189 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 11:42:47.751433 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.751415 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 11:42:47.751530 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.751511 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 11:42:47.751530 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.751523 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s8lrm\"" May 21 11:42:47.751727 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.751651 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 11:42:47.781666 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.781634 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 11:37:46 +0000 UTC" deadline="2027-11-18 19:16:28.466469764 +0000 UTC" May 21 11:42:47.781753 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.781669 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13111h33m40.684805015s" May 21 11:42:47.840685 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.840340 2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 11:42:47.850048 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-kubelet\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.850198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-env-overrides\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.850198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850092 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cec6820b-7195-437d-8572-59ffea1ba1b7-serviceca\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.850198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850136 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-kubernetes\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850158 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-cnibin\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.850198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850182 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqb6\" (UniqueName: \"kubernetes.io/projected/e3392d96-9470-4af6-93fa-3f63dc600c6a-kube-api-access-xxqb6\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850243 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-cnibin\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850248 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-kubernetes\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-config\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850328 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-conf\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850352 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-tuned\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850376 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-system-cni-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850393 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850408 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-netns\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.850440 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850432 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67e27acc-42b4-4007-8ec9-5cbf70c71deb-iptables-alerter-script\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-bin\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850479 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-run\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850500 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-system-cni-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850500 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-conf\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850504 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-lib-modules\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850536 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-run\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-netns\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850557 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-registration-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850584 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgx2m\" (UniqueName: \"kubernetes.io/projected/f56fb641-79ba-4785-8b20-ee531cdbb21a-kube-api-access-sgx2m\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850611 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr49w\" (UniqueName: \"kubernetes.io/projected/cec6820b-7195-437d-8572-59ffea1ba1b7-kube-api-access-lr49w\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850629 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-lib-modules\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-registration-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850638 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850582 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cec6820b-7195-437d-8572-59ffea1ba1b7-serviceca\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-cnibin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850706 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850714 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 11:42:47.850891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850733 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-agent-certs\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850761 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-netd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850788 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850825 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-host\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850841 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850849 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-tmp\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850893 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-os-release\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850916 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-host\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-systemd-units\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-cnibin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850978 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.850984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851027 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-os-release\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851058 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-k8s-cni-cncf-io\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.851068 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851089 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-multus-certs\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.851722 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851094 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-k8s-cni-cncf-io\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-netns\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851136 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-run-multus-certs\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.851148 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:42:48.35111888 +0000 UTC m=+3.115750849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851176 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851198 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-systemd\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851222 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccdch\" (UniqueName: \"kubernetes.io/projected/08beb4c2-4188-450b-b813-6f96a06a837c-kube-api-access-ccdch\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851249 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-sys-fs\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851271 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cec6820b-7195-437d-8572-59ffea1ba1b7-host\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851276 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-systemd\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851295 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-modprobe-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysctl-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851321 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-system-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cec6820b-7195-437d-8572-59ffea1ba1b7-host\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-sys-fs\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e27acc-42b4-4007-8ec9-5cbf70c71deb-host-slash\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-system-cni-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.852552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851379 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-modprobe-d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851386 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851412 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-socket-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851426 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851477 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-device-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851503 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-konnectivity-ca\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-socket-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851543 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-slash\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851534 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-device-dir\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-systemd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovn-node-metrics-cert\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851624 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851651 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851677 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-etc-kubernetes\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-script-lib\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851729 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-cni-binary-copy\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-daemon-config\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853343 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851780 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysconfig\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851784 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b6b942-eb89-4c90-a056-f739da1a88c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851808 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851833 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-bin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851883 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-conf-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lglf8\" (UniqueName: \"kubernetes.io/projected/67e27acc-42b4-4007-8ec9-5cbf70c71deb-kube-api-access-lglf8\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-var-lib-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-ovn\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.851987 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfnt\" (UniqueName: \"kubernetes.io/projected/e3b6b942-eb89-4c90-a056-f739da1a88c5-kube-api-access-8sfnt\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852011 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-os-release\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852040 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-socket-dir-parent\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-konnectivity-ca\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-etc-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-node-log\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852111 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-etc-kubernetes\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852127 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852155 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-sys\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.853959 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852181 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-var-lib-kubelet\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852206 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-multus\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852209 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-sysconfig\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852231 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-kubelet\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852275 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-hostroot\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852304 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s6xz\" (UniqueName: \"kubernetes.io/projected/c9e3c63b-0c70-4231-bd31-bdc969e7776a-kube-api-access-5s6xz\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852332 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z427d\" (UniqueName: \"kubernetes.io/projected/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-kube-api-access-z427d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852340 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-cni-binary-copy\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852364 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-log-socket\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852402 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-kubelet\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852239 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852474 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-hostroot\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f56fb641-79ba-4785-8b20-ee531cdbb21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-os-release\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852546 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-sys\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852587 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-socket-dir-parent\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b6b942-eb89-4c90-a056-f739da1a88c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-conf-dir\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.854648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-bin\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852709 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3392d96-9470-4af6-93fa-3f63dc600c6a-host-var-lib-cni-multus\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.852716 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-var-lib-kubelet\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.853525 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3392d96-9470-4af6-93fa-3f63dc600c6a-multus-daemon-config\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.854454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-etc-tuned\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.854531 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-tmp\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.855316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.854928 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbf58f2-ebb8-44b0-8015-cc1a139917e4-agent-certs\") pod \"konnectivity-agent-5l2w9\" (UID: \"ddbf58f2-ebb8-44b0-8015-cc1a139917e4\") " pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:47.860437 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.860414 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqb6\" (UniqueName: \"kubernetes.io/projected/e3392d96-9470-4af6-93fa-3f63dc600c6a-kube-api-access-xxqb6\") pod \"multus-plmwv\" (UID: \"e3392d96-9470-4af6-93fa-3f63dc600c6a\") " pod="openshift-multus/multus-plmwv" May 21 11:42:47.863245 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.862870 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:42:47.863245 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.862937 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:42:47.863245 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.862952 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:47.863245 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:47.863012 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:42:48.362993515 +0000 UTC m=+3.127625487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:47.864458 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.864435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfnt\" (UniqueName: \"kubernetes.io/projected/e3b6b942-eb89-4c90-a056-f739da1a88c5-kube-api-access-8sfnt\") pod \"multus-additional-cni-plugins-fm9pn\" (UID: \"e3b6b942-eb89-4c90-a056-f739da1a88c5\") " pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:47.864626 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.864599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr49w\" (UniqueName: \"kubernetes.io/projected/cec6820b-7195-437d-8572-59ffea1ba1b7-kube-api-access-lr49w\") pod \"node-ca-tlkjf\" (UID: \"cec6820b-7195-437d-8572-59ffea1ba1b7\") " pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:47.864848 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.864827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z427d\" (UniqueName: \"kubernetes.io/projected/21d7dfa7-13d2-4ab9-9ecb-6211b94df13e-kube-api-access-z427d\") pod \"tuned-rjmr8\" (UID: \"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:47.865262 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.865241 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgx2m\" (UniqueName: \"kubernetes.io/projected/f56fb641-79ba-4785-8b20-ee531cdbb21a-kube-api-access-sgx2m\") pod \"aws-ebs-csi-driver-node-dmj44\" (UID: \"f56fb641-79ba-4785-8b20-ee531cdbb21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:47.866129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.866112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccdch\" (UniqueName: \"kubernetes.io/projected/08beb4c2-4188-450b-b813-6f96a06a837c-kube-api-access-ccdch\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:47.952957 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.952853 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5s6xz\" (UniqueName: \"kubernetes.io/projected/c9e3c63b-0c70-4231-bd31-bdc969e7776a-kube-api-access-5s6xz\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.952957 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.952911 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-log-socket\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.952967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-log-socket\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953004 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-kubelet\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953033 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-env-overrides\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953059 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-config\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-kubelet\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953091 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67e27acc-42b4-4007-8ec9-5cbf70c71deb-iptables-alerter-script\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953237 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-bin\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953284 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-netd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953323 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-systemd-units\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953339 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-bin\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953350 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953375 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953404 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953396 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-cni-netd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953435 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-netns\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953467 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e27acc-42b4-4007-8ec9-5cbf70c71deb-host-slash\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-systemd-units\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953499 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-slash\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953511 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953524 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-systemd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953538 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953557 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovn-node-metrics-cert\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953565 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e27acc-42b4-4007-8ec9-5cbf70c71deb-host-slash\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953588 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-run-netns\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953586 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-script-lib\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953610 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-env-overrides\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953619 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lglf8\" (UniqueName: \"kubernetes.io/projected/67e27acc-42b4-4007-8ec9-5cbf70c71deb-kube-api-access-lglf8\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953664 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-var-lib-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.953840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953690 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-ovn\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953707 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-etc-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953716 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-config\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953724 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-node-log\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-node-log\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953832 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-etc-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67e27acc-42b4-4007-8ec9-5cbf70c71deb-iptables-alerter-script\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953870 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-var-lib-openvswitch\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953897 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-ovn\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953911 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-run-systemd\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.953923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9e3c63b-0c70-4231-bd31-bdc969e7776a-host-slash\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.954515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.954068 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovnkube-script-lib\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.956410 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.956383 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9e3c63b-0c70-4231-bd31-bdc969e7776a-ovn-node-metrics-cert\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.964262 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.964238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s6xz\" (UniqueName: \"kubernetes.io/projected/c9e3c63b-0c70-4231-bd31-bdc969e7776a-kube-api-access-5s6xz\") pod \"ovnkube-node-q4hxb\" (UID: \"c9e3c63b-0c70-4231-bd31-bdc969e7776a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:47.964378 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:47.964340 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lglf8\" (UniqueName: \"kubernetes.io/projected/67e27acc-42b4-4007-8ec9-5cbf70c71deb-kube-api-access-lglf8\") pod \"iptables-alerter-ncbxg\" (UID: \"67e27acc-42b4-4007-8ec9-5cbf70c71deb\") " pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:48.035372 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.035333 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" May 21 11:42:48.045386 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.045361 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" May 21 11:42:48.052974 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.052952 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-plmwv" May 21 11:42:48.058625 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.058605 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:42:48.065199 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.065181 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" May 21 11:42:48.071729 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.071710 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlkjf" May 21 11:42:48.079271 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.079252 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncbxg" May 21 11:42:48.083835 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.083818 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:42:48.356605 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.356535 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:48.356752 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.356634 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:48.356752 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.356692 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:42:49.356674008 +0000 UTC m=+4.121305961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:48.457724 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.457694 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:48.457961 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.457876 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:42:48.457961 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.457899 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:42:48.457961 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.457912 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:48.458134 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.457976 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:42:49.457957121 +0000 UTC m=+4.222589072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:48.467826 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.467797 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56fb641_79ba_4785_8b20_ee531cdbb21a.slice/crio-8c8d24116be9f39a98b4c610c3a897f52fee23de0e19f53ef1eba2f8e0056e5f WatchSource:0}: Error finding container 8c8d24116be9f39a98b4c610c3a897f52fee23de0e19f53ef1eba2f8e0056e5f: Status 404 returned error can't find the container with id 8c8d24116be9f39a98b4c610c3a897f52fee23de0e19f53ef1eba2f8e0056e5f May 21 11:42:48.476750 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.476620 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3392d96_9470_4af6_93fa_3f63dc600c6a.slice/crio-867e02b647190d1f49040cb96cf952b0e6986cc30c233587136ed1d17a616587 WatchSource:0}: Error finding container 867e02b647190d1f49040cb96cf952b0e6986cc30c233587136ed1d17a616587: Status 404 returned error can't find the container with id 867e02b647190d1f49040cb96cf952b0e6986cc30c233587136ed1d17a616587 May 21 11:42:48.477951 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.477806 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d7dfa7_13d2_4ab9_9ecb_6211b94df13e.slice/crio-83133944a945f98933956adaaa24b6d85f3c079587f6210aaef3953e66dc0081 WatchSource:0}: Error finding container 83133944a945f98933956adaaa24b6d85f3c079587f6210aaef3953e66dc0081: Status 404 returned error can't find the container with id 83133944a945f98933956adaaa24b6d85f3c079587f6210aaef3953e66dc0081 May 21 11:42:48.479879 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.478637 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec6820b_7195_437d_8572_59ffea1ba1b7.slice/crio-ada6a397b773d8d0037faf46d7306bed938375210540224a9823991ecc737e55 WatchSource:0}: Error finding container ada6a397b773d8d0037faf46d7306bed938375210540224a9823991ecc737e55: Status 404 returned error can't find the container with id ada6a397b773d8d0037faf46d7306bed938375210540224a9823991ecc737e55 May 21 11:42:48.479879 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.479564 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e3c63b_0c70_4231_bd31_bdc969e7776a.slice/crio-d0756a6ae6290664b61ddf690407081d460cb3486dc64ef0c1954801093bf334 WatchSource:0}: Error finding container d0756a6ae6290664b61ddf690407081d460cb3486dc64ef0c1954801093bf334: Status 404 returned error can't find the container with id d0756a6ae6290664b61ddf690407081d460cb3486dc64ef0c1954801093bf334 May 21 11:42:48.480250 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:42:48.480179 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbf58f2_ebb8_44b0_8015_cc1a139917e4.slice/crio-43c43efe417e4f3569a4f846bb73e51b9d3bf5f3108f6c2b68b2730210aaa9bf WatchSource:0}: Error finding container 43c43efe417e4f3569a4f846bb73e51b9d3bf5f3108f6c2b68b2730210aaa9bf: Status 404 returned error can't find the container with id 43c43efe417e4f3569a4f846bb73e51b9d3bf5f3108f6c2b68b2730210aaa9bf May 21 11:42:48.613823 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.613636 2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:42:48.782102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.782063 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 11:37:46 +0000 UTC" deadline="2027-12-23 14:00:08.183250561 +0000 UTC" May 21 11:42:48.782102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.782090 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13946h17m19.401162196s" May 21 11:42:48.868552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.868489 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:48.868673 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:48.868611 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:48.876752 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.876710 2557 generic.go:358] "Generic (PLEG): container finished" podID="cdb38f211b718540000930af38b651a0" containerID="c7b0d59cb86b0fee9ecb614b48a847f982b09f3f8ec23737864602caa1c549c5" exitCode=0 May 21 11:42:48.876892 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.876804 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"cdb38f211b718540000930af38b651a0","Type":"ContainerDied","Data":"c7b0d59cb86b0fee9ecb614b48a847f982b09f3f8ec23737864602caa1c549c5"} May 21 11:42:48.879360 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.879314 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" event={"ID":"90aca22efb10402ecfb9f75795df2729","Type":"ContainerStarted","Data":"60251286fb940055dc513d46c358a06a6efa4a732fec539cc93787cb2a77cac6"} May 21 11:42:48.881166 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.881141 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5l2w9" event={"ID":"ddbf58f2-ebb8-44b0-8015-cc1a139917e4","Type":"ContainerStarted","Data":"43c43efe417e4f3569a4f846bb73e51b9d3bf5f3108f6c2b68b2730210aaa9bf"} May 21 11:42:48.882467 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.882408 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" event={"ID":"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e","Type":"ContainerStarted","Data":"83133944a945f98933956adaaa24b6d85f3c079587f6210aaef3953e66dc0081"} May 21 11:42:48.883464 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.883438 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-plmwv" event={"ID":"e3392d96-9470-4af6-93fa-3f63dc600c6a","Type":"ContainerStarted","Data":"867e02b647190d1f49040cb96cf952b0e6986cc30c233587136ed1d17a616587"} May 21 11:42:48.885325 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.885253 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncbxg" event={"ID":"67e27acc-42b4-4007-8ec9-5cbf70c71deb","Type":"ContainerStarted","Data":"b5179aaa808ed261abce14ae19999f203917c897f80b6c5f4bebf204fe7eb56b"} May 21 11:42:48.886964 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.886939 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerStarted","Data":"4a15f98cde009d0edd4a9a326886d724026ef6abfb5b828b6dc84b8e19b4556e"} May 21 11:42:48.888280 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.888258 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" event={"ID":"f56fb641-79ba-4785-8b20-ee531cdbb21a","Type":"ContainerStarted","Data":"8c8d24116be9f39a98b4c610c3a897f52fee23de0e19f53ef1eba2f8e0056e5f"} May 21 11:42:48.890016 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.889984 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlkjf" event={"ID":"cec6820b-7195-437d-8572-59ffea1ba1b7","Type":"ContainerStarted","Data":"ada6a397b773d8d0037faf46d7306bed938375210540224a9823991ecc737e55"} May 21 11:42:48.891131 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:48.891109 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"d0756a6ae6290664b61ddf690407081d460cb3486dc64ef0c1954801093bf334"} May 21 11:42:49.365419 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:49.365383 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:49.365602 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.365557 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:49.365657 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.365623 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:42:51.365601744 +0000 UTC m=+6.130233708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:49.467210 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:49.466529 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:49.467210 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.466705 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:42:49.467210 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.466727 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:42:49.467210 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.466739 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:49.467210 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.466797 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:42:51.466779434 +0000 UTC m=+6.231411389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:49.879024 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:49.878989 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:49.879482 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:49.879187 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:49.907957 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:49.907925 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"cdb38f211b718540000930af38b651a0","Type":"ContainerStarted","Data":"4f866c233a2dea27b1fb263724e1c0576a6f51fecf4038a6f87a0681681dc66c"} May 21 11:42:49.924008 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:49.922945 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" podStartSLOduration=3.922926446 podStartE2EDuration="3.922926446s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:42:48.906252988 +0000 UTC m=+3.670884961" watchObservedRunningTime="2026-05-21 11:42:49.922926446 +0000 UTC m=+4.687558419" May 21 11:42:50.868819 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:50.868788 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:50.869028 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:50.868945 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:51.382464 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:51.382432 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:51.382935 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.382566 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:51.382935 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.382644 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:42:55.382622388 +0000 UTC m=+10.147254353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:51.483529 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:51.483492 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:51.483695 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.483666 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:42:51.483695 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.483686 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:42:51.483800 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.483699 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:51.483800 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.483755 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:42:55.48373596 +0000 UTC m=+10.248367908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:51.868664 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:51.868629 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:51.868854 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:51.868778 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:52.869010 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:52.868975 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:52.869447 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:52.869096 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:53.869280 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:53.869247 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:53.869664 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:53.869394 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:54.868679 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:54.868646 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:54.868888 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:54.868779 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:55.416539 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:55.416283 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:55.416539 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.416459 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:55.416539 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.416536 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:03.416514003 +0000 UTC m=+18.181145975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:42:55.517843 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:55.517232 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:55.517843 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.517439 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:42:55.517843 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.517456 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:42:55.517843 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.517470 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:55.517843 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.517533 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:03.517509133 +0000 UTC m=+18.282141082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:42:55.869880 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:55.869361 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:55.869880 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:55.869494 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:56.869542 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:56.869505 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:56.869978 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:56.869633 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:57.869298 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:57.869261 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:57.869511 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:57.869400 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:42:58.868621 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:58.868583 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:42:58.869074 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:58.868706 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:42:59.868843 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:42:59.868807 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:42:59.869268 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:42:59.868974 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:00.868662 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:00.868631 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:00.868835 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:00.868740 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:00.924258 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:00.924196 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" podStartSLOduration=14.924177244 podStartE2EDuration="14.924177244s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:42:49.923917955 +0000 UTC m=+4.688549926" watchObservedRunningTime="2026-05-21 11:43:00.924177244 +0000 UTC m=+15.688809218" May 21 11:43:00.924669 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:00.924560 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-l8lxx"] May 21 11:43:00.940816 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:00.940794 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:00.940971 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:00.940870 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:01.058807 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.058763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-dbus\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.058985 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.058815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-kubelet-config\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.058985 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.058883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.159946 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.159854 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-kubelet-config\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.159946 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.159916 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.160140 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.159960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-kubelet-config\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.160140 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:01.160067 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:01.160140 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.160096 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-dbus\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.160140 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:01.160131 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:01.660112125 +0000 UTC m=+16.424744089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:01.160312 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.160242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38b9b06-5885-4368-929b-1f4fe73ae3ab-dbus\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.664757 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.664716 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:01.664971 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:01.664893 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:01.665047 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:01.664979 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:02.66495682 +0000 UTC m=+17.429588769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:01.869327 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:01.869290 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:01.869490 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:01.869417 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:02.672308 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:02.672271 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:02.672738 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:02.672431 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:02.672738 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:02.672508 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:04.672485507 +0000 UTC m=+19.437117462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:02.869137 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:02.869105 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:02.869306 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:02.869102 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:02.869306 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:02.869214 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:02.869410 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:02.869300 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:03.476490 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:03.476456 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:03.476652 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.476597 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:03.476709 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.476671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:19.476650508 +0000 UTC m=+34.241282461 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:03.577223 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:03.577182 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:03.577684 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.577655 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:03.579886 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.577684 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:03.579886 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.578486 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:03.579886 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.578556 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:19.578529841 +0000 UTC m=+34.343161804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:03.869210 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:03.869124 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:03.869674 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:03.869274 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:04.684319 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:04.684281 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:04.684618 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:04.684407 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:04.684618 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:04.684483 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:08.684464404 +0000 UTC m=+23.449096353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:04.868950 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:04.868916 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:04.869123 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:04.868916 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:04.869123 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:04.869049 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:04.869123 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:04.869102 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:05.870009 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:05.869971 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:05.870460 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:05.870115 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:06.869156 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.868737 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:06.869325 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.868737 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:06.869325 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:06.869229 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:06.869412 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:06.869318 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:06.938526 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.938482 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5l2w9" event={"ID":"ddbf58f2-ebb8-44b0-8015-cc1a139917e4","Type":"ContainerStarted","Data":"88db71e06a70bb18ea8074e0c8fe9b986c5710fe886948225a287a6096c51968"} May 21 11:43:06.939997 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.939969 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" event={"ID":"21d7dfa7-13d2-4ab9-9ecb-6211b94df13e","Type":"ContainerStarted","Data":"a411fa2b5536f22272431d6df820940dc6d008786b47f43a8adc786ed04d2486"} May 21 11:43:06.941382 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.941359 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-plmwv" event={"ID":"e3392d96-9470-4af6-93fa-3f63dc600c6a","Type":"ContainerStarted","Data":"6f7265b20f6849e2d395c1181ad5d0e4258467fc9f27181cf3dff184c92b485f"} May 21 11:43:06.942936 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.942915 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="e9d6228c9cae0955d7a7662a39ab3162959786068b783b6444d99dc0c952841c" exitCode=0 May 21 11:43:06.943018 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.942980 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"e9d6228c9cae0955d7a7662a39ab3162959786068b783b6444d99dc0c952841c"} May 21 11:43:06.944386 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.944278 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" event={"ID":"f56fb641-79ba-4785-8b20-ee531cdbb21a","Type":"ContainerStarted","Data":"e8d7e0333fa0533af7a408da8d9221eaf098cb7049d180ed33516b70c054b2ca"} May 21 11:43:06.945718 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.945703 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlkjf" event={"ID":"cec6820b-7195-437d-8572-59ffea1ba1b7","Type":"ContainerStarted","Data":"748e962b7aff2a66f78f957dae2b99dc8f41312f195a47120f42bb981a7e1ac4"} May 21 11:43:06.949026 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949004 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"e5cc99890a9b0152e6fe1072475c9ad794217f33a412e8dde94c75d857d245bb"} May 21 11:43:06.949102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949032 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"9080631d7476ad9853c33c686d4cd6edc3011a632a8fddf4a5ba04d5b68bd5d6"} May 21 11:43:06.949102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949046 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"287be60e5d9c1e4569531b298a068e0c1b1ec9488187e27cd9d9ae7b7d093c1f"} May 21 11:43:06.949102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949056 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"e7e247e62a42cde021f297a0afd5b4f578310807cd27d3fdbb8cc3873e052b15"} May 21 11:43:06.949102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949065 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"a53ae5237b34f9a65a7e5c1e5ab59714b4bd2d20432378acfad4a9dba6c660e7"} May 21 11:43:06.949102 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.949081 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"0bd1bbf72244ddc59baf992c9ad4edb28a16465fa1acb0afdf909f867531bb01"} May 21 11:43:06.954385 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.954342 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5l2w9" podStartSLOduration=3.146080785 podStartE2EDuration="20.95432871s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.501774403 +0000 UTC m=+3.266406352" lastFinishedPulling="2026-05-21 11:43:06.310022318 +0000 UTC m=+21.074654277" observedRunningTime="2026-05-21 11:43:06.954196306 +0000 UTC m=+21.718828278" watchObservedRunningTime="2026-05-21 11:43:06.95432871 +0000 UTC m=+21.718960682" May 21 11:43:06.969595 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:06.969557 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rjmr8" podStartSLOduration=4.159973482 podStartE2EDuration="21.96954441s" podCreationTimestamp="2026-05-21 11:42:45 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.501874367 +0000 UTC m=+3.266506316" lastFinishedPulling="2026-05-21 11:43:06.311445291 +0000 UTC m=+21.076077244" observedRunningTime="2026-05-21 11:43:06.969196984 +0000 UTC m=+21.733828966" watchObservedRunningTime="2026-05-21 11:43:06.96954441 +0000 UTC m=+21.734176380" May 21 11:43:07.004982 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.004938 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tlkjf" podStartSLOduration=3.196808933 podStartE2EDuration="21.004923884s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.501900698 +0000 UTC m=+3.266532657" lastFinishedPulling="2026-05-21 11:43:06.310015646 +0000 UTC m=+21.074647608" observedRunningTime="2026-05-21 11:43:07.004702315 +0000 UTC m=+21.769334288" watchObservedRunningTime="2026-05-21 11:43:07.004923884 +0000 UTC m=+21.769555855" May 21 11:43:07.391761 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.391735 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 11:43:07.814063 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.813942 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T11:43:07.391756577Z","UUID":"8def680a-048f-436b-8a48-8275c3970c79","Handler":null,"Name":"","Endpoint":""} May 21 11:43:07.815759 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.815730 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 11:43:07.815759 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.815763 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 11:43:07.868949 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.868912 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:07.869136 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:07.869050 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:07.952517 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.952480 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncbxg" event={"ID":"67e27acc-42b4-4007-8ec9-5cbf70c71deb","Type":"ContainerStarted","Data":"af252f8c92c5d72102f5e5ff7f1b2d57e24223b92d838c03fb0b6fa290cd7130"} May 21 11:43:07.954578 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.954549 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" event={"ID":"f56fb641-79ba-4785-8b20-ee531cdbb21a","Type":"ContainerStarted","Data":"7bd7672a9f0d56cc5e4ec9f8fee23a794ae623e6eb2f8b785d3c5ac9cb29ec03"} May 21 11:43:07.982276 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.982221 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-plmwv" podStartSLOduration=5.122878538 podStartE2EDuration="22.982205512s" podCreationTimestamp="2026-05-21 11:42:45 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.501797545 +0000 UTC m=+3.266429502" lastFinishedPulling="2026-05-21 11:43:06.36112452 +0000 UTC m=+21.125756476" observedRunningTime="2026-05-21 11:43:07.025402798 +0000 UTC m=+21.790034770" watchObservedRunningTime="2026-05-21 11:43:07.982205512 +0000 UTC m=+22.746837532" May 21 11:43:07.982497 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:07.982468 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ncbxg" podStartSLOduration=4.148048215 podStartE2EDuration="21.982458631s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.47559438 +0000 UTC m=+3.240226330" lastFinishedPulling="2026-05-21 11:43:06.310004797 +0000 UTC m=+21.074636746" observedRunningTime="2026-05-21 11:43:07.981986446 +0000 UTC m=+22.746618430" watchObservedRunningTime="2026-05-21 11:43:07.982458631 +0000 UTC m=+22.747090604" May 21 11:43:08.232627 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.232395 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-97xcr"] May 21 11:43:08.236375 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.236349 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.239454 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.239419 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 11:43:08.239600 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.239458 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brzsq\"" May 21 11:43:08.239699 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.239681 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 11:43:08.313849 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.313821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhr9v\" (UniqueName: \"kubernetes.io/projected/e1983cb3-ecc9-439c-b96d-0939ac7ec812-kube-api-access-lhr9v\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.313979 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.313958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1983cb3-ecc9-439c-b96d-0939ac7ec812-hosts-file\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.314023 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.313994 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1983cb3-ecc9-439c-b96d-0939ac7ec812-tmp-dir\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.414654 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.414628 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhr9v\" (UniqueName: \"kubernetes.io/projected/e1983cb3-ecc9-439c-b96d-0939ac7ec812-kube-api-access-lhr9v\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.414793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.414694 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1983cb3-ecc9-439c-b96d-0939ac7ec812-hosts-file\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.414793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.414724 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1983cb3-ecc9-439c-b96d-0939ac7ec812-tmp-dir\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.414904 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.414777 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1983cb3-ecc9-439c-b96d-0939ac7ec812-hosts-file\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.415095 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.415078 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1983cb3-ecc9-439c-b96d-0939ac7ec812-tmp-dir\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.425428 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.425397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhr9v\" (UniqueName: \"kubernetes.io/projected/e1983cb3-ecc9-439c-b96d-0939ac7ec812-kube-api-access-lhr9v\") pod \"node-resolver-97xcr\" (UID: \"e1983cb3-ecc9-439c-b96d-0939ac7ec812\") " pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.548412 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.548325 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97xcr" May 21 11:43:08.556917 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:08.556884 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1983cb3_ecc9_439c_b96d_0939ac7ec812.slice/crio-bb87c86bad2f112d9b6b88d79586efffd11e1c03b78d51b1097b3eb3f83dcec3 WatchSource:0}: Error finding container bb87c86bad2f112d9b6b88d79586efffd11e1c03b78d51b1097b3eb3f83dcec3: Status 404 returned error can't find the container with id bb87c86bad2f112d9b6b88d79586efffd11e1c03b78d51b1097b3eb3f83dcec3 May 21 11:43:08.716746 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.716702 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:08.716918 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:08.716834 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:08.716918 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:08.716919 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:16.716901215 +0000 UTC m=+31.481533170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:08.869427 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.869399 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:08.869554 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.869403 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:08.869554 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:08.869536 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:08.869664 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:08.869600 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:08.958748 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.958480 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" event={"ID":"f56fb641-79ba-4785-8b20-ee531cdbb21a","Type":"ContainerStarted","Data":"55415b43fee392d51f836ea7b6f3431969a5f07d33553d10e81496cd06d63f1b"} May 21 11:43:08.961879 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.961828 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"20800fcb11834ee8d62b10613064583ca74a4df95b7dae29ceb32154d2a39054"} May 21 11:43:08.963932 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.963837 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97xcr" event={"ID":"e1983cb3-ecc9-439c-b96d-0939ac7ec812","Type":"ContainerStarted","Data":"c3c0ed3ada7967eefe19b1bfd0846bd8df8e22c7cf44d1268ff48eb5fd39281f"} May 21 11:43:08.963932 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.963898 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97xcr" event={"ID":"e1983cb3-ecc9-439c-b96d-0939ac7ec812","Type":"ContainerStarted","Data":"bb87c86bad2f112d9b6b88d79586efffd11e1c03b78d51b1097b3eb3f83dcec3"} May 21 11:43:08.978249 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.978196 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmj44" podStartSLOduration=3.138146756 podStartE2EDuration="22.978180204s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.470453525 +0000 UTC m=+3.235085477" lastFinishedPulling="2026-05-21 11:43:08.310486958 +0000 UTC m=+23.075118925" observedRunningTime="2026-05-21 11:43:08.977214316 +0000 UTC m=+23.741846290" watchObservedRunningTime="2026-05-21 11:43:08.978180204 +0000 UTC m=+23.742812176" May 21 11:43:08.993432 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:08.993380 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-97xcr" podStartSLOduration=0.993363806 podStartE2EDuration="993.363806ms" podCreationTimestamp="2026-05-21 11:43:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:43:08.993085441 +0000 UTC m=+23.757717413" watchObservedRunningTime="2026-05-21 11:43:08.993363806 +0000 UTC m=+23.757995776" May 21 11:43:09.405572 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:09.405539 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:43:09.406191 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:09.406174 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:43:09.868979 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:09.868946 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:09.869199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:09.869092 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:09.965651 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:09.965613 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:43:09.966370 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:09.966343 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5l2w9" May 21 11:43:10.868686 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:10.868653 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:10.868891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:10.868654 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:10.868891 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:10.868772 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:10.868891 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:10.868853 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:11.868848 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.868657 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:11.869532 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:11.868980 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:11.970054 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.970025 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="c928239acdedc55a54fec25b48b11155fe95ea0c3c7eb88faa9f14e056cf18a8" exitCode=0 May 21 11:43:11.970234 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.970102 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"c928239acdedc55a54fec25b48b11155fe95ea0c3c7eb88faa9f14e056cf18a8"} May 21 11:43:11.973341 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.973303 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" event={"ID":"c9e3c63b-0c70-4231-bd31-bdc969e7776a","Type":"ContainerStarted","Data":"f5900fe285c4048ab7bd51ef374f1aaebb8552a11c2ee23f0d555841ef515c43"} May 21 11:43:11.973638 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.973616 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:11.973726 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.973647 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:11.989003 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:11.988977 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:12.025619 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.025570 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" podStartSLOduration=8.14628158 podStartE2EDuration="26.025556867s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.502042657 +0000 UTC m=+3.266674621" lastFinishedPulling="2026-05-21 11:43:06.381317945 +0000 UTC m=+21.145949908" observedRunningTime="2026-05-21 11:43:12.023572899 +0000 UTC m=+26.788204871" watchObservedRunningTime="2026-05-21 11:43:12.025556867 +0000 UTC m=+26.790188838" May 21 11:43:12.869028 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.868981 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:12.869406 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:12.869104 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:12.869406 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.868982 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:12.869406 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:12.869195 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:12.977172 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.977142 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="fd78f9148486bc084c8307cf68c4825a8f6e5973113aaf4935ded9547e93f316" exitCode=0 May 21 11:43:12.977322 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.977234 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"fd78f9148486bc084c8307cf68c4825a8f6e5973113aaf4935ded9547e93f316"} May 21 11:43:12.977730 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.977702 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:12.993521 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:12.993492 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:13.107730 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.107649 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8lxx"] May 21 11:43:13.107871 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.107776 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:13.107930 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:13.107877 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:13.111155 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.111113 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbws8"] May 21 11:43:13.111289 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.111260 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:13.111395 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:13.111371 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:13.111831 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.111808 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-znxqq"] May 21 11:43:13.111950 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.111938 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:13.112064 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:13.112040 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:13.980711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.980679 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="2350d0cb31e5af7342e0ee983b9fbf8e691d4222b17b7c16bd5f75d9e15a6a9e" exitCode=0 May 21 11:43:13.981119 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:13.980799 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"2350d0cb31e5af7342e0ee983b9fbf8e691d4222b17b7c16bd5f75d9e15a6a9e"} May 21 11:43:14.868981 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:14.868946 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:14.869153 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:14.869068 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:14.869153 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:14.868946 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:14.869153 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:14.868946 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:14.869153 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:14.869145 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:14.869347 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:14.869237 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:16.778508 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:16.778260 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:16.779103 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:16.778440 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 11:43:16.779103 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:16.778632 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret podName:a38b9b06-5885-4368-929b-1f4fe73ae3ab nodeName:}" failed. No retries permitted until 2026-05-21 11:43:32.778611357 +0000 UTC m=+47.543243313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret") pod "global-pull-secret-syncer-l8lxx" (UID: "a38b9b06-5885-4368-929b-1f4fe73ae3ab") : object "kube-system"/"original-pull-secret" not registered May 21 11:43:16.869237 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:16.869201 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:16.869391 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:16.869202 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:16.869391 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:16.869317 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:16.869391 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:16.869202 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:16.869500 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:16.869392 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:16.869500 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:16.869451 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:18.869197 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:18.869152 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:18.869197 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:18.869193 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:18.869818 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:18.869224 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:18.869818 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:18.869328 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8lxx" podUID="a38b9b06-5885-4368-929b-1f4fe73ae3ab" May 21 11:43:18.869818 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:18.869369 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbws8" podUID="6539ec1f-2da7-488a-a011-dfa7ce445a52" May 21 11:43:18.869818 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:18.869435 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:43:19.498435 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:19.498392 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:19.498719 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.498571 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:19.498719 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.498646 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:51.498623962 +0000 UTC m=+66.263255918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:19.599261 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:19.599223 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:19.599456 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.599422 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:19.599456 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.599450 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:19.599564 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.599464 2557 projected.go:194] Error preparing data for projected volume kube-api-access-dqc5b for pod openshift-network-diagnostics/network-check-target-mbws8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:19.599564 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:19.599524 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b podName:6539ec1f-2da7-488a-a011-dfa7ce445a52 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:51.599507659 +0000 UTC m=+66.364139609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dqc5b" (UniqueName: "kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b") pod "network-check-target-mbws8" (UID: "6539ec1f-2da7-488a-a011-dfa7ce445a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:20.043447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.043368 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeReady" May 21 11:43:20.044038 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.043528 2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 11:43:20.078486 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.078454 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4d94758-77t44"] May 21 11:43:20.111029 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.110964 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb"] May 21 11:43:20.127127 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.127011 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.127127 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.127029 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.127127 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.127001 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw"] May 21 11:43:20.129608 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.129582 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 11:43:20.129741 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.129622 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 11:43:20.130018 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.129997 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vbb66\"" May 21 11:43:20.130133 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.130030 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 11:43:20.130383 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.130362 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 11:43:20.130479 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.130461 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5dxzl\"" May 21 11:43:20.131007 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.130988 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 11:43:20.131110 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.131028 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 11:43:20.131427 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.131409 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 11:43:20.135637 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.135617 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 11:43:20.142955 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.142928 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2rdf9"] May 21 11:43:20.143094 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.143066 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.145456 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.145425 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 11:43:20.161035 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.161012 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79"] May 21 11:43:20.161188 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.161167 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.165318 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.165298 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 11:43:20.165714 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.165675 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 11:43:20.165968 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.165925 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6x8vn\"" May 21 11:43:20.184273 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.184172 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4d94758-77t44"] May 21 11:43:20.184393 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.184287 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7"] May 21 11:43:20.184393 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.184316 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.186951 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.186931 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 11:43:20.187109 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.186933 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 11:43:20.187390 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.187374 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zsdgm\"" May 21 11:43:20.203066 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203179 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203179 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203274 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203274 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d38b94d2-319f-4250-b58a-e657529ebc64-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.203274 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203398 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8bhv\" (UniqueName: \"kubernetes.io/projected/d38b94d2-319f-4250-b58a-e657529ebc64-kube-api-access-l8bhv\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.203398 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203398 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2k2f\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203398 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203358 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.203557 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203447 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6hq25"] May 21 11:43:20.203629 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.203614 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.207278 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.207245 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 11:43:20.207490 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.207296 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 11:43:20.207490 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.207311 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 11:43:20.207490 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.207391 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 11:43:20.227567 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227538 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227574 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227591 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227606 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rdf9"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227618 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hq25"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227625 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7"] May 21 11:43:20.227696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.227686 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.230473 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.230453 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 11:43:20.230582 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.230515 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cwzz8\"" May 21 11:43:20.230643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.230580 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 11:43:20.230698 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.230668 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 11:43:20.304884 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.304884 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304845 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.304884 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zwm\" (UniqueName: \"kubernetes.io/projected/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-kube-api-access-98zwm\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1fcda-3443-4369-89cb-42510fef1366-tmp\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304933 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.304980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f39afa81-0679-4172-8faa-996ffca86b4f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305024 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d38b94d2-319f-4250-b58a-e657529ebc64-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305082 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8bhv\" (UniqueName: \"kubernetes.io/projected/d38b94d2-319f-4250-b58a-e657529ebc64-kube-api-access-l8bhv\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-tmp-dir\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.305129 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305129 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qb4\" (UniqueName: \"kubernetes.io/projected/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-kube-api-access-27qb4\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305187 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2k2f\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305225 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305248 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305302 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21b1fcda-3443-4369-89cb-42510fef1366-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-config-volume\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.305389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqjc\" (UniqueName: \"kubernetes.io/projected/21b1fcda-3443-4369-89cb-42510fef1366-kube-api-access-cqqjc\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305415 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305450 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwfp9\" (UniqueName: \"kubernetes.io/projected/f39afa81-0679-4172-8faa-996ffca86b4f-kube-api-access-jwfp9\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6e241b9-237c-47bc-93e3-096bbc8c6669-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.305643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.305559 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.305940 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.305900 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:20.305940 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.305920 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:20.306037 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.305973 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:20.805954523 +0000 UTC m=+35.570586472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:20.306425 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.306381 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.306538 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.306433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.306639 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.306597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.310176 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.310155 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.310176 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.310164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.310342 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.310321 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d38b94d2-319f-4250-b58a-e657529ebc64-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.321677 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.321650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8bhv\" (UniqueName: \"kubernetes.io/projected/d38b94d2-319f-4250-b58a-e657529ebc64-kube-api-access-l8bhv\") pod \"managed-serviceaccount-addon-agent-7464f6dc76-m42mb\" (UID: \"d38b94d2-319f-4250-b58a-e657529ebc64\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.321783 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.321704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.321985 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.321942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2k2f\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.406131 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406093 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-tmp-dir\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.406297 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406149 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27qb4\" (UniqueName: \"kubernetes.io/projected/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-kube-api-access-27qb4\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.406297 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406191 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.406297 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406214 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21b1fcda-3443-4369-89cb-42510fef1366-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.406297 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406253 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-config-volume\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.406297 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406278 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406304 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqjc\" (UniqueName: \"kubernetes.io/projected/21b1fcda-3443-4369-89cb-42510fef1366-kube-api-access-cqqjc\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.406333 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406343 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406381 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwfp9\" (UniqueName: \"kubernetes.io/projected/f39afa81-0679-4172-8faa-996ffca86b4f-kube-api-access-jwfp9\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.406400 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:20.906381303 +0000 UTC m=+35.671013270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406399 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-tmp-dir\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406433 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6e241b9-237c-47bc-93e3-096bbc8c6669-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.406468 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406464 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406508 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406537 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98zwm\" (UniqueName: \"kubernetes.io/projected/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-kube-api-access-98zwm\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406564 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1fcda-3443-4369-89cb-42510fef1366-tmp\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406590 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406611 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f39afa81-0679-4172-8faa-996ffca86b4f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.406620 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406639 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.406765 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.406671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:20.906654415 +0000 UTC m=+35.671286377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:20.407155 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.406761 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-config-volume\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.407212 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.407163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6e241b9-237c-47bc-93e3-096bbc8c6669-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.407262 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.407245 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:20.407317 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.407286 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:20.907273428 +0000 UTC m=+35.671905379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:20.407571 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.407548 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1fcda-3443-4369-89cb-42510fef1366-tmp\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.407878 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.407839 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f39afa81-0679-4172-8faa-996ffca86b4f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.409386 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.409340 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21b1fcda-3443-4369-89cb-42510fef1366-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.409590 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.409558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.409725 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.409703 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.409725 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.409715 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.410507 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.410486 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f39afa81-0679-4172-8faa-996ffca86b4f-ca\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.415826 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.415800 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqjc\" (UniqueName: \"kubernetes.io/projected/21b1fcda-3443-4369-89cb-42510fef1366-kube-api-access-cqqjc\") pod \"klusterlet-addon-workmgr-7bd764b685-qncrw\" (UID: \"21b1fcda-3443-4369-89cb-42510fef1366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.415949 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.415833 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zwm\" (UniqueName: \"kubernetes.io/projected/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-kube-api-access-98zwm\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.416092 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.416053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwfp9\" (UniqueName: \"kubernetes.io/projected/f39afa81-0679-4172-8faa-996ffca86b4f-kube-api-access-jwfp9\") pod \"cluster-proxy-proxy-agent-55cd9cb589-86pj7\" (UID: \"f39afa81-0679-4172-8faa-996ffca86b4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.416390 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.416374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qb4\" (UniqueName: \"kubernetes.io/projected/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-kube-api-access-27qb4\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.446247 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.446211 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" May 21 11:43:20.463333 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.463299 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:20.513533 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.513498 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:43:20.791268 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.791238 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7"] May 21 11:43:20.795627 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.795603 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw"] May 21 11:43:20.798076 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.798056 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb"] May 21 11:43:20.800569 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:20.800541 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39afa81_0679_4172_8faa_996ffca86b4f.slice/crio-846560370c5ceedbfb2ebf2488fb7d2ca70329695f77e71ebc3e4904ad62ffed WatchSource:0}: Error finding container 846560370c5ceedbfb2ebf2488fb7d2ca70329695f77e71ebc3e4904ad62ffed: Status 404 returned error can't find the container with id 846560370c5ceedbfb2ebf2488fb7d2ca70329695f77e71ebc3e4904ad62ffed May 21 11:43:20.801064 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:20.801041 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b1fcda_3443_4369_89cb_42510fef1366.slice/crio-45a87b2419205d1a7a5b80d044c2367a779ec4cad410a90b40973c83c6cff79e WatchSource:0}: Error finding container 45a87b2419205d1a7a5b80d044c2367a779ec4cad410a90b40973c83c6cff79e: Status 404 returned error can't find the container with id 45a87b2419205d1a7a5b80d044c2367a779ec4cad410a90b40973c83c6cff79e May 21 11:43:20.801803 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:20.801780 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd38b94d2_319f_4250_b58a_e657529ebc64.slice/crio-6891c44e00c3218161fd8a6146880e20257605a7b37c54360e17def26ad312a9 WatchSource:0}: Error finding container 6891c44e00c3218161fd8a6146880e20257605a7b37c54360e17def26ad312a9: Status 404 returned error can't find the container with id 6891c44e00c3218161fd8a6146880e20257605a7b37c54360e17def26ad312a9 May 21 11:43:20.812216 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.812195 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:20.812365 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.812342 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:20.812365 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.812366 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:20.812483 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.812423 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:21.812401977 +0000 UTC m=+36.577033926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:20.869090 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.869066 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:20.869199 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.869128 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:20.869199 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.869160 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:20.872074 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.872049 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ds8sh\"" May 21 11:43:20.872166 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.872096 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p6q78\"" May 21 11:43:20.872306 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.872268 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 11:43:20.872372 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.872308 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 11:43:20.873273 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.873250 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 11:43:20.873648 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.873633 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 11:43:20.912701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.912678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:20.912786 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.912732 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:20.912786 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.912762 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:20.912852 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912833 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:20.912977 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912874 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:20.912977 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912882 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:20.912977 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912916 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:21.912889065 +0000 UTC m=+36.677521013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:20.912977 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912933 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:21.912924391 +0000 UTC m=+36.677556339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:20.912977 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:20.912943 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:21.912937964 +0000 UTC m=+36.677569912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:20.994703 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.994663 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" event={"ID":"21b1fcda-3443-4369-89cb-42510fef1366","Type":"ContainerStarted","Data":"45a87b2419205d1a7a5b80d044c2367a779ec4cad410a90b40973c83c6cff79e"} May 21 11:43:20.995689 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.995664 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" event={"ID":"d38b94d2-319f-4250-b58a-e657529ebc64","Type":"ContainerStarted","Data":"6891c44e00c3218161fd8a6146880e20257605a7b37c54360e17def26ad312a9"} May 21 11:43:20.996647 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:20.996620 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerStarted","Data":"846560370c5ceedbfb2ebf2488fb7d2ca70329695f77e71ebc3e4904ad62ffed"} May 21 11:43:21.000809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:21.000785 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerStarted","Data":"f1caf6ad1fc9e8918cf0c2daf9a9ea139009785c0e5be0c023c6d6754163872c"} May 21 11:43:21.822186 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:21.822148 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:21.822909 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.822341 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:21.822909 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.822366 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:21.822909 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.822430 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:23.822409587 +0000 UTC m=+38.587041570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:21.923372 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:21.923329 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923510 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:21.923546 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923586 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:23.923565324 +0000 UTC m=+38.688197290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:21.923632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923681 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923735 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:23.923716554 +0000 UTC m=+38.688348518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923806 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:21.923873 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:21.923846 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:23.923834222 +0000 UTC m=+38.688466179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:22.008413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:22.008378 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="f1caf6ad1fc9e8918cf0c2daf9a9ea139009785c0e5be0c023c6d6754163872c" exitCode=0 May 21 11:43:22.008556 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:22.008450 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"f1caf6ad1fc9e8918cf0c2daf9a9ea139009785c0e5be0c023c6d6754163872c"} May 21 11:43:23.016660 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.015918 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3b6b942-eb89-4c90-a056-f739da1a88c5" containerID="0f686fc6e8b3ddb62bfa56effe10842898d9b2f1353c8d895070689b9208e1e6" exitCode=0 May 21 11:43:23.016660 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.016002 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerDied","Data":"0f686fc6e8b3ddb62bfa56effe10842898d9b2f1353c8d895070689b9208e1e6"} May 21 11:43:23.846105 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.846031 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:23.846332 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.846258 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:23.846332 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.846275 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:23.846451 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.846337 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:27.846318112 +0000 UTC m=+42.610950066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:23.947188 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.947146 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:23.947345 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.947200 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:23.947345 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:23.947298 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:23.947345 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947319 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:23.947496 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947361 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:23.947496 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947398 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:23.947496 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947420 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:27.947398872 +0000 UTC m=+42.712030840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:23.947496 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947450 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:27.947432695 +0000 UTC m=+42.712064651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:23.947496 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:23.947470 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:27.947460567 +0000 UTC m=+42.712092519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:27.879977 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:27.879774 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:27.880468 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.879933 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:27.880468 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.880058 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:27.880468 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.880132 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:35.880108777 +0000 UTC m=+50.644740728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:27.980838 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:27.980786 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:27.981041 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:27.980918 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:27.981041 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:27.980966 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:27.981041 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.980997 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:27.981199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.981047 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:27.981199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.981074 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:35.98105312 +0000 UTC m=+50.745685070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:27.981199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.981097 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:35.981086006 +0000 UTC m=+50.745717961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:27.981199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.981047 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:27.981199 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:27.981153 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:35.981143528 +0000 UTC m=+50.745775500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:29.030109 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.030068 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" event={"ID":"e3b6b942-eb89-4c90-a056-f739da1a88c5","Type":"ContainerStarted","Data":"c63b795871a8a7f2cfb42e681698689f3793bd55672c5e5b1a9c7d8746a857da"} May 21 11:43:29.031299 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.031274 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" event={"ID":"21b1fcda-3443-4369-89cb-42510fef1366","Type":"ContainerStarted","Data":"be024cdf9650c4a64f4ed5bf943e90835486f848c3e05c7174c6b2eaa46f7625"} May 21 11:43:29.031445 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.031427 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:29.032460 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.032435 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" event={"ID":"d38b94d2-319f-4250-b58a-e657529ebc64","Type":"ContainerStarted","Data":"cf957ea7635642dc20bb4650d1c65bad9edb6aba589fa19d1c1b8f93766145b6"} May 21 11:43:29.033348 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.033325 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:43:29.033700 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.033681 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerStarted","Data":"519447bf9c7eb0eecb112be3c3b9237cbcbb8da408815c682d183280efe1f980"} May 21 11:43:29.054877 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.054817 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fm9pn" podStartSLOduration=11.703727124 podStartE2EDuration="44.054804106s" podCreationTimestamp="2026-05-21 11:42:45 +0000 UTC" firstStartedPulling="2026-05-21 11:42:48.479722716 +0000 UTC m=+3.244354670" lastFinishedPulling="2026-05-21 11:43:20.830799702 +0000 UTC m=+35.595431652" observedRunningTime="2026-05-21 11:43:29.054023663 +0000 UTC m=+43.818655646" watchObservedRunningTime="2026-05-21 11:43:29.054804106 +0000 UTC m=+43.819436076" May 21 11:43:29.070943 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.070897 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" podStartSLOduration=27.346123889 podStartE2EDuration="35.070882806s" podCreationTimestamp="2026-05-21 11:42:54 +0000 UTC" firstStartedPulling="2026-05-21 11:43:20.805350777 +0000 UTC m=+35.569982727" lastFinishedPulling="2026-05-21 11:43:28.530109682 +0000 UTC m=+43.294741644" observedRunningTime="2026-05-21 11:43:29.069948173 +0000 UTC m=+43.834580155" watchObservedRunningTime="2026-05-21 11:43:29.070882806 +0000 UTC m=+43.835514771" May 21 11:43:29.086013 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:29.085969 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" podStartSLOduration=27.418453351 podStartE2EDuration="35.085952405s" podCreationTimestamp="2026-05-21 11:42:54 +0000 UTC" firstStartedPulling="2026-05-21 11:43:20.805613306 +0000 UTC m=+35.570245255" lastFinishedPulling="2026-05-21 11:43:28.473112354 +0000 UTC m=+43.237744309" observedRunningTime="2026-05-21 11:43:29.085529118 +0000 UTC m=+43.850161090" watchObservedRunningTime="2026-05-21 11:43:29.085952405 +0000 UTC m=+43.850584376" May 21 11:43:32.041449 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.041407 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerStarted","Data":"356d692de2db35516dcb89d3cba572deb7445a15701ba10b7a030c5fa8fa2fd7"} May 21 11:43:32.041449 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.041450 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerStarted","Data":"36fad54ce464103b61521749eb8cc9d8fb0b78faf588782eb0c96c734fae54d5"} May 21 11:43:32.061485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.061423 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" podStartSLOduration=27.869667938 podStartE2EDuration="38.061408739s" podCreationTimestamp="2026-05-21 11:42:54 +0000 UTC" firstStartedPulling="2026-05-21 11:43:20.805498508 +0000 UTC m=+35.570130461" lastFinishedPulling="2026-05-21 11:43:30.99723931 +0000 UTC m=+45.761871262" observedRunningTime="2026-05-21 11:43:32.059436933 +0000 UTC m=+46.824068904" watchObservedRunningTime="2026-05-21 11:43:32.061408739 +0000 UTC m=+46.826040709" May 21 11:43:32.819555 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.819518 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:32.823258 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.823234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38b9b06-5885-4368-929b-1f4fe73ae3ab-original-pull-secret\") pod \"global-pull-secret-syncer-l8lxx\" (UID: \"a38b9b06-5885-4368-929b-1f4fe73ae3ab\") " pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:32.898772 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:32.898736 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8lxx" May 21 11:43:33.017592 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:33.017561 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8lxx"] May 21 11:43:33.020233 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:33.020201 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38b9b06_5885_4368_929b_1f4fe73ae3ab.slice/crio-b717c341da710c9adff03e3634c6394150be249aa234bcd836d17a768fcd62c5 WatchSource:0}: Error finding container b717c341da710c9adff03e3634c6394150be249aa234bcd836d17a768fcd62c5: Status 404 returned error can't find the container with id b717c341da710c9adff03e3634c6394150be249aa234bcd836d17a768fcd62c5 May 21 11:43:33.044263 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:33.044238 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8lxx" event={"ID":"a38b9b06-5885-4368-929b-1f4fe73ae3ab","Type":"ContainerStarted","Data":"b717c341da710c9adff03e3634c6394150be249aa234bcd836d17a768fcd62c5"} May 21 11:43:35.947378 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:35.947337 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:35.948016 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:35.947553 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:35.948016 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:35.947576 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:35.948016 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:35.947649 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:43:51.947627348 +0000 UTC m=+66.712259302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:36.048342 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:36.048308 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:36.048532 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:36.048383 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:36.048532 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:36.048417 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:36.048532 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048440 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:36.048532 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048499 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:43:52.048481155 +0000 UTC m=+66.813113126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:36.048729 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048559 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:36.048729 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048594 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:52.048582566 +0000 UTC m=+66.813214525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:36.048729 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048660 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:36.048729 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:36.048692 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:52.048682339 +0000 UTC m=+66.813314301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:38.054643 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:38.054608 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8lxx" event={"ID":"a38b9b06-5885-4368-929b-1f4fe73ae3ab","Type":"ContainerStarted","Data":"422faf9ab5b554b9fcbb6025766132a8342df479befb2a73d6f657ba9005c21d"} May 21 11:43:38.071139 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:38.071094 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l8lxx" podStartSLOduration=34.006080221 podStartE2EDuration="38.07108251s" podCreationTimestamp="2026-05-21 11:43:00 +0000 UTC" firstStartedPulling="2026-05-21 11:43:33.021940863 +0000 UTC m=+47.786572813" lastFinishedPulling="2026-05-21 11:43:37.086943139 +0000 UTC m=+51.851575102" observedRunningTime="2026-05-21 11:43:38.070563645 +0000 UTC m=+52.835195630" watchObservedRunningTime="2026-05-21 11:43:38.07108251 +0000 UTC m=+52.835714481" May 21 11:43:44.993184 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:44.993153 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4hxb" May 21 11:43:51.564984 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.564944 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:43:51.568237 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.568217 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 11:43:51.575698 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:51.575676 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 11:43:51.575748 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:51.575738 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:44:55.575719637 +0000 UTC m=+130.340351586 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : secret "metrics-daemon-secret" not found May 21 11:43:51.665509 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.665472 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:51.668634 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.668615 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 11:43:51.678638 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.678617 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 11:43:51.689149 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.689120 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqc5b\" (UniqueName: \"kubernetes.io/projected/6539ec1f-2da7-488a-a011-dfa7ce445a52-kube-api-access-dqc5b\") pod \"network-check-target-mbws8\" (UID: \"6539ec1f-2da7-488a-a011-dfa7ce445a52\") " pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:51.795732 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.795706 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p6q78\"" May 21 11:43:51.802926 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.802907 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:51.922349 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.922320 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbws8"] May 21 11:43:51.925366 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:43:51.925337 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6539ec1f_2da7_488a_a011_dfa7ce445a52.slice/crio-0adccb248c41a2dafd38582a51abcea10dceadb5b49ce8bfb797c36b6a35977d WatchSource:0}: Error finding container 0adccb248c41a2dafd38582a51abcea10dceadb5b49ce8bfb797c36b6a35977d: Status 404 returned error can't find the container with id 0adccb248c41a2dafd38582a51abcea10dceadb5b49ce8bfb797c36b6a35977d May 21 11:43:51.968395 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:51.968361 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:43:51.968563 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:51.968536 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:43:51.968563 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:51.968560 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:43:51.968636 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:51.968626 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:44:23.968611414 +0000 UTC m=+98.733243364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:43:52.069064 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:52.069028 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:43:52.069064 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:52.069068 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:43:52.069294 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:52.069123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:43:52.069294 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069191 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:43:52.069294 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069257 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:43:52.069294 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069280 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:43:52.069479 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069268 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:44:24.069250633 +0000 UTC m=+98.833882581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:43:52.069479 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069409 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:44:24.069375305 +0000 UTC m=+98.834007257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:43:52.069479 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:43:52.069424 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:44:24.069418212 +0000 UTC m=+98.834050160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:43:52.083551 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:52.083517 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbws8" event={"ID":"6539ec1f-2da7-488a-a011-dfa7ce445a52","Type":"ContainerStarted","Data":"0adccb248c41a2dafd38582a51abcea10dceadb5b49ce8bfb797c36b6a35977d"} May 21 11:43:56.095377 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:56.095339 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbws8" event={"ID":"6539ec1f-2da7-488a-a011-dfa7ce445a52","Type":"ContainerStarted","Data":"52b02a695c81d3c2bfb0000338dd35fe2d85aec71bb7298acec7936b85fd0bac"} May 21 11:43:56.095766 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:56.095499 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:43:56.115114 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:43:56.115063 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mbws8" podStartSLOduration=66.917630639 podStartE2EDuration="1m10.115049984s" podCreationTimestamp="2026-05-21 11:42:46 +0000 UTC" firstStartedPulling="2026-05-21 11:43:51.927228617 +0000 UTC m=+66.691860565" lastFinishedPulling="2026-05-21 11:43:55.124647956 +0000 UTC m=+69.889279910" observedRunningTime="2026-05-21 11:43:56.114201508 +0000 UTC m=+70.878833480" watchObservedRunningTime="2026-05-21 11:43:56.115049984 +0000 UTC m=+70.879681954" May 21 11:44:24.021573 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:24.021528 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:44:24.022043 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.021655 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:44:24.022043 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.021668 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:44:24.022043 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.021723 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:45:28.02170448 +0000 UTC m=+162.786336445 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:44:24.122363 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:24.122316 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:44:24.122528 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:24.122371 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:44:24.122528 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:24.122420 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:44:24.122528 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122497 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:24.122528 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122506 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:24.122673 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122549 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:45:28.122536102 +0000 UTC m=+162.887168051 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:44:24.122673 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122506 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:44:24.122673 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122562 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:28.122556676 +0000 UTC m=+162.887188625 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:44:24.122673 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:24.122581 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:28.122568539 +0000 UTC m=+162.887200488 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:44:27.101107 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:27.101078 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mbws8" May 21 11:44:55.672348 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:44:55.672292 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:44:55.672829 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:55.672429 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 11:44:55.672829 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:44:55.672499 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs podName:08beb4c2-4188-450b-b813-6f96a06a837c nodeName:}" failed. No retries permitted until 2026-05-21 11:46:57.672484216 +0000 UTC m=+252.437116164 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs") pod "network-metrics-daemon-znxqq" (UID: "08beb4c2-4188-450b-b813-6f96a06a837c") : secret "metrics-daemon-secret" not found May 21 11:45:23.155571 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:23.155527 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b4d94758-77t44" podUID="585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" May 21 11:45:23.171695 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:23.171662 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2rdf9" podUID="65ef81f8-5858-4a2d-af9a-e6fb8f141d9a" May 21 11:45:23.193973 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:23.193939 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" podUID="d6e241b9-237c-47bc-93e3-096bbc8c6669" May 21 11:45:23.256894 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:23.256838 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6hq25" podUID="7d10e4e6-6857-4ab9-81fd-9c31035a0de1" May 21 11:45:23.294763 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:23.294732 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rdf9" May 21 11:45:23.294933 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:23.294732 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:45:23.294933 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:23.294739 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:45:23.295007 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:23.294740 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:45:23.883578 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:23.883536 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-znxqq" podUID="08beb4c2-4188-450b-b813-6f96a06a837c" May 21 11:45:28.117787 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:28.117739 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") pod \"image-registry-7b4d94758-77t44\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:45:28.118451 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.117892 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 11:45:28.118451 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.117911 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4d94758-77t44: secret "image-registry-tls" not found May 21 11:45:28.118451 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.117973 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls podName:585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e nodeName:}" failed. No retries permitted until 2026-05-21 11:47:30.117958725 +0000 UTC m=+284.882590680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls") pod "image-registry-7b4d94758-77t44" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e") : secret "image-registry-tls" not found May 21 11:45:28.218523 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:28.218482 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:28.218541 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218631 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218647 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:28.218658 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218686 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert podName:d6e241b9-237c-47bc-93e3-096bbc8c6669 nodeName:}" failed. No retries permitted until 2026-05-21 11:47:30.218672726 +0000 UTC m=+284.983304676 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gwf79" (UID: "d6e241b9-237c-47bc-93e3-096bbc8c6669") : secret "networking-console-plugin-cert" not found May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218716 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218720 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls podName:65ef81f8-5858-4a2d-af9a-e6fb8f141d9a nodeName:}" failed. No retries permitted until 2026-05-21 11:47:30.218700347 +0000 UTC m=+284.983332376 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls") pod "dns-default-2rdf9" (UID: "65ef81f8-5858-4a2d-af9a-e6fb8f141d9a") : secret "dns-default-metrics-tls" not found May 21 11:45:28.218771 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:45:28.218748 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert podName:7d10e4e6-6857-4ab9-81fd-9c31035a0de1 nodeName:}" failed. No retries permitted until 2026-05-21 11:47:30.218738895 +0000 UTC m=+284.983370844 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert") pod "ingress-canary-6hq25" (UID: "7d10e4e6-6857-4ab9-81fd-9c31035a0de1") : secret "canary-serving-cert" not found May 21 11:45:29.032002 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.031903 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" podUID="21b1fcda-3443-4369-89cb-42510fef1366" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" May 21 11:45:29.309688 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.309610 2557 generic.go:358] "Generic (PLEG): container finished" podID="d38b94d2-319f-4250-b58a-e657529ebc64" containerID="cf957ea7635642dc20bb4650d1c65bad9edb6aba589fa19d1c1b8f93766145b6" exitCode=255 May 21 11:45:29.309688 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.309675 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" event={"ID":"d38b94d2-319f-4250-b58a-e657529ebc64","Type":"ContainerDied","Data":"cf957ea7635642dc20bb4650d1c65bad9edb6aba589fa19d1c1b8f93766145b6"} May 21 11:45:29.310159 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.310019 2557 scope.go:117] "RemoveContainer" containerID="cf957ea7635642dc20bb4650d1c65bad9edb6aba589fa19d1c1b8f93766145b6" May 21 11:45:29.310984 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.310963 2557 generic.go:358] "Generic (PLEG): container finished" podID="21b1fcda-3443-4369-89cb-42510fef1366" containerID="be024cdf9650c4a64f4ed5bf943e90835486f848c3e05c7174c6b2eaa46f7625" exitCode=1 May 21 11:45:29.311052 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.311001 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" event={"ID":"21b1fcda-3443-4369-89cb-42510fef1366","Type":"ContainerDied","Data":"be024cdf9650c4a64f4ed5bf943e90835486f848c3e05c7174c6b2eaa46f7625"} May 21 11:45:29.311322 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.311274 2557 scope.go:117] "RemoveContainer" containerID="be024cdf9650c4a64f4ed5bf943e90835486f848c3e05c7174c6b2eaa46f7625" May 21 11:45:29.540529 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:29.540503 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97xcr_e1983cb3-ecc9-439c-b96d-0939ac7ec812/dns-node-resolver/0.log" May 21 11:45:30.314684 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:30.314651 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7464f6dc76-m42mb" event={"ID":"d38b94d2-319f-4250-b58a-e657529ebc64","Type":"ContainerStarted","Data":"3051d64be76c45f25a838d77f3043266ab167b76b623bec09be80ebecaffc262"} May 21 11:45:30.315988 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:30.315969 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" event={"ID":"21b1fcda-3443-4369-89cb-42510fef1366","Type":"ContainerStarted","Data":"d8913bedc828e795f088c9dfd9401a3f5adf3187856b11dd27babed49e8c5738"} May 21 11:45:30.316227 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:30.316213 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:45:30.316820 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:30.316803 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd764b685-qncrw" May 21 11:45:30.938233 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:30.938196 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlkjf_cec6820b-7195-437d-8572-59ffea1ba1b7/node-ca/0.log" May 21 11:45:35.870253 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:35.870165 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:45:50.514992 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:50.514952 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" podUID="f39afa81-0679-4172-8faa-996ffca86b4f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 11:45:55.634555 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.634520 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hgzjn"] May 21 11:45:55.637760 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.637738 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.640692 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.640674 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 11:45:55.640969 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.640954 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 11:45:55.641033 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.641007 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9d8jx\"" May 21 11:45:55.642254 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.642236 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 11:45:55.642353 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.642237 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 11:45:55.660907 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.660883 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgzjn"] May 21 11:45:55.736791 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.736762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-crio-socket\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.736950 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.736817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.736950 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.736894 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.737067 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.736952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-data-volume\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.737067 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.737020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9tk\" (UniqueName: \"kubernetes.io/projected/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-api-access-ht9tk\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837385 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837353 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-data-volume\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837560 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837444 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9tk\" (UniqueName: \"kubernetes.io/projected/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-api-access-ht9tk\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837560 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837489 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-crio-socket\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837560 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837528 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837560 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837556 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837763 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-crio-socket\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.837763 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.837752 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-data-volume\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.838125 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.838103 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.840186 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.840164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.846552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.846530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9tk\" (UniqueName: \"kubernetes.io/projected/ab4d42ec-4d27-4a27-9329-e0053c6b8e64-kube-api-access-ht9tk\") pod \"insights-runtime-extractor-hgzjn\" (UID: \"ab4d42ec-4d27-4a27-9329-e0053c6b8e64\") " pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:55.946249 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:55.946139 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgzjn" May 21 11:45:56.067670 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:56.067639 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgzjn"] May 21 11:45:56.070871 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:45:56.070831 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4d42ec_4d27_4a27_9329_e0053c6b8e64.slice/crio-0e145df3134e12e003165eb5930b97d8eefbc0f41ffa4877a12ca998e190a312 WatchSource:0}: Error finding container 0e145df3134e12e003165eb5930b97d8eefbc0f41ffa4877a12ca998e190a312: Status 404 returned error can't find the container with id 0e145df3134e12e003165eb5930b97d8eefbc0f41ffa4877a12ca998e190a312 May 21 11:45:56.377240 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:56.377205 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgzjn" event={"ID":"ab4d42ec-4d27-4a27-9329-e0053c6b8e64","Type":"ContainerStarted","Data":"650ff1f6d61105927caceb0f23195a150ce57e3bda8c3387cdcfebff2367d549"} May 21 11:45:56.377240 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:56.377244 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgzjn" event={"ID":"ab4d42ec-4d27-4a27-9329-e0053c6b8e64","Type":"ContainerStarted","Data":"0e145df3134e12e003165eb5930b97d8eefbc0f41ffa4877a12ca998e190a312"} May 21 11:45:57.381951 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:57.381910 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgzjn" event={"ID":"ab4d42ec-4d27-4a27-9329-e0053c6b8e64","Type":"ContainerStarted","Data":"2b19e8f60b2be2cc1e27cbd406e0e134e6e3c8fdd7a057a514323e4900841459"} May 21 11:45:59.388994 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:59.388958 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgzjn" event={"ID":"ab4d42ec-4d27-4a27-9329-e0053c6b8e64","Type":"ContainerStarted","Data":"670bbb1fe3291f80ec7044c54b81a3a03ca3cbdb9e9ca7e4bbdec71b8e050475"} May 21 11:45:59.406624 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:45:59.406577 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hgzjn" podStartSLOduration=2.131679321 podStartE2EDuration="4.406562787s" podCreationTimestamp="2026-05-21 11:45:55 +0000 UTC" firstStartedPulling="2026-05-21 11:45:56.132274925 +0000 UTC m=+190.896906874" lastFinishedPulling="2026-05-21 11:45:58.407158375 +0000 UTC m=+193.171790340" observedRunningTime="2026-05-21 11:45:59.406097467 +0000 UTC m=+194.170729461" watchObservedRunningTime="2026-05-21 11:45:59.406562787 +0000 UTC m=+194.171194758" May 21 11:46:00.514444 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:00.514402 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" podUID="f39afa81-0679-4172-8faa-996ffca86b4f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 11:46:07.450702 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.450666 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zdnmk"] May 21 11:46:07.453755 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.453739 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.458907 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.458887 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 11:46:07.459057 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.458946 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 11:46:07.459384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.459361 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 11:46:07.459493 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.459365 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 11:46:07.459493 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.459445 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 11:46:07.460155 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.460138 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c756g\"" May 21 11:46:07.460672 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.460510 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 11:46:07.535017 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.534978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-sys\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535017 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-root\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535267 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535267 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535267 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-wtmp\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535267 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535209 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-metrics-client-ca\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535267 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgjs\" (UniqueName: \"kubernetes.io/projected/1fb38283-459e-4721-a5fb-96329cedccba-kube-api-access-8sgjs\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535446 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.535446 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.535334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-textfile\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636489 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636451 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgjs\" (UniqueName: \"kubernetes.io/projected/1fb38283-459e-4721-a5fb-96329cedccba-kube-api-access-8sgjs\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636489 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636492 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636528 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-textfile\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636569 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-sys\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636597 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-root\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636655 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-root\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:46:07.636672 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 11:46:07.636711 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636694 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-sys\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:46:07.636754 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls podName:1fb38283-459e-4721-a5fb-96329cedccba nodeName:}" failed. No retries permitted until 2026-05-21 11:46:08.136733462 +0000 UTC m=+202.901365415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls") pod "node-exporter-zdnmk" (UID: "1fb38283-459e-4721-a5fb-96329cedccba") : secret "node-exporter-tls" not found May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636779 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636847 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-wtmp\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636906 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-metrics-client-ca\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.636908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-textfile\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637031 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.637028 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-wtmp\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637309 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.637291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.637552 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.637533 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb38283-459e-4721-a5fb-96329cedccba-metrics-client-ca\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.638940 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.638922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:07.647087 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:07.647057 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgjs\" (UniqueName: \"kubernetes.io/projected/1fb38283-459e-4721-a5fb-96329cedccba-kube-api-access-8sgjs\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:08.140496 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:08.140463 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:08.142811 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:08.142787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1fb38283-459e-4721-a5fb-96329cedccba-node-exporter-tls\") pod \"node-exporter-zdnmk\" (UID: \"1fb38283-459e-4721-a5fb-96329cedccba\") " pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:08.363556 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:08.363521 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdnmk" May 21 11:46:08.371303 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:46:08.371275 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb38283_459e_4721_a5fb_96329cedccba.slice/crio-8e058b6c807cb11e29106926517948a30736cc94d95cb401b9a227560298a7d1 WatchSource:0}: Error finding container 8e058b6c807cb11e29106926517948a30736cc94d95cb401b9a227560298a7d1: Status 404 returned error can't find the container with id 8e058b6c807cb11e29106926517948a30736cc94d95cb401b9a227560298a7d1 May 21 11:46:08.411179 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:08.411108 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnmk" event={"ID":"1fb38283-459e-4721-a5fb-96329cedccba","Type":"ContainerStarted","Data":"8e058b6c807cb11e29106926517948a30736cc94d95cb401b9a227560298a7d1"} May 21 11:46:10.418703 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.418662 2557 generic.go:358] "Generic (PLEG): container finished" podID="1fb38283-459e-4721-a5fb-96329cedccba" containerID="49d9c8c9dbb6adfcf37e7408b8bd7d3a8cac63d62007566e512319b6d41e899e" exitCode=0 May 21 11:46:10.419076 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.418733 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnmk" event={"ID":"1fb38283-459e-4721-a5fb-96329cedccba","Type":"ContainerDied","Data":"49d9c8c9dbb6adfcf37e7408b8bd7d3a8cac63d62007566e512319b6d41e899e"} May 21 11:46:10.515245 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.515213 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" podUID="f39afa81-0679-4172-8faa-996ffca86b4f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 11:46:10.515338 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.515285 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" May 21 11:46:10.515725 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.515698 2557 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"356d692de2db35516dcb89d3cba572deb7445a15701ba10b7a030c5fa8fa2fd7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 11:46:10.515765 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:10.515745 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" podUID="f39afa81-0679-4172-8faa-996ffca86b4f" containerName="service-proxy" containerID="cri-o://356d692de2db35516dcb89d3cba572deb7445a15701ba10b7a030c5fa8fa2fd7" gracePeriod=30 May 21 11:46:11.422791 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.422751 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnmk" event={"ID":"1fb38283-459e-4721-a5fb-96329cedccba","Type":"ContainerStarted","Data":"5278162427cc3c597f80a6b53e7d1dd9041a37361b30f9bf165dd6688c18e48e"} May 21 11:46:11.422791 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.422791 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnmk" event={"ID":"1fb38283-459e-4721-a5fb-96329cedccba","Type":"ContainerStarted","Data":"89a1e8dc6a5b37ff3e663193a4a342f41597c347a1a0c07b0b75e778c5804724"} May 21 11:46:11.424590 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.424568 2557 generic.go:358] "Generic (PLEG): container finished" podID="f39afa81-0679-4172-8faa-996ffca86b4f" containerID="356d692de2db35516dcb89d3cba572deb7445a15701ba10b7a030c5fa8fa2fd7" exitCode=2 May 21 11:46:11.424686 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.424598 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerDied","Data":"356d692de2db35516dcb89d3cba572deb7445a15701ba10b7a030c5fa8fa2fd7"} May 21 11:46:11.424686 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.424614 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55cd9cb589-86pj7" event={"ID":"f39afa81-0679-4172-8faa-996ffca86b4f","Type":"ContainerStarted","Data":"7f9c231320c26792ad6344a07a367256f90e17a03fb9b34446fe019f8b48be14"} May 21 11:46:11.447965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:11.447925 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zdnmk" podStartSLOduration=3.471322652 podStartE2EDuration="4.44791494s" podCreationTimestamp="2026-05-21 11:46:07 +0000 UTC" firstStartedPulling="2026-05-21 11:46:08.373127724 +0000 UTC m=+203.137759681" lastFinishedPulling="2026-05-21 11:46:09.34972002 +0000 UTC m=+204.114351969" observedRunningTime="2026-05-21 11:46:11.446592635 +0000 UTC m=+206.211224633" watchObservedRunningTime="2026-05-21 11:46:11.44791494 +0000 UTC m=+206.212546910" May 21 11:46:18.652126 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:18.652087 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4d94758-77t44"] May 21 11:46:18.652544 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:46:18.652327 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b4d94758-77t44" podUID="585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" May 21 11:46:19.443336 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.443306 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:46:19.447233 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.447205 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:46:19.638333 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638296 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638343 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638387 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638406 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638425 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2k2f\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638485 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638454 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638723 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638504 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates\") pod \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\" (UID: \"585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e\") " May 21 11:46:19.638780 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638731 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:46:19.638934 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638909 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:46:19.638934 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.638921 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-ca-trust-extracted\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.639132 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.639108 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:46:19.640569 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.640538 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:46:19.640729 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.640708 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:46:19.640982 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.640962 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f" (OuterVolumeSpecName: "kube-api-access-k2k2f") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "kube-api-access-k2k2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:46:19.641050 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.641007 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" (UID: "585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739707 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-installation-pull-secrets\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739732 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-certificates\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739742 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-image-registry-private-configuration\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739753 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-trusted-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739763 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-bound-sa-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:19.739779 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:19.739771 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2k2f\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-kube-api-access-k2k2f\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:20.445642 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:20.445612 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d94758-77t44" May 21 11:46:20.478654 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:20.478622 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4d94758-77t44"] May 21 11:46:20.484434 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:20.484406 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b4d94758-77t44"] May 21 11:46:20.648109 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:20.648063 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e-registry-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:46:21.872124 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:21.872096 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e" path="/var/lib/kubelet/pods/585c1a51-bbe8-4e95-bcb7-d0fa0b78da6e/volumes" May 21 11:46:57.715923 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:57.715844 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:46:57.718109 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:57.718089 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08beb4c2-4188-450b-b813-6f96a06a837c-metrics-certs\") pod \"network-metrics-daemon-znxqq\" (UID: \"08beb4c2-4188-450b-b813-6f96a06a837c\") " pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:46:57.775006 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:57.774976 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ds8sh\"" May 21 11:46:57.781413 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:57.781391 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znxqq" May 21 11:46:57.912045 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:57.912014 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-znxqq"] May 21 11:46:57.916694 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:46:57.916671 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08beb4c2_4188_450b_b813_6f96a06a837c.slice/crio-3e19f261ddddc3b336ec8a0e81ae812bd3e16627651c7837454d4b3cf56c2c1b WatchSource:0}: Error finding container 3e19f261ddddc3b336ec8a0e81ae812bd3e16627651c7837454d4b3cf56c2c1b: Status 404 returned error can't find the container with id 3e19f261ddddc3b336ec8a0e81ae812bd3e16627651c7837454d4b3cf56c2c1b May 21 11:46:58.543965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:58.543924 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znxqq" event={"ID":"08beb4c2-4188-450b-b813-6f96a06a837c","Type":"ContainerStarted","Data":"3e19f261ddddc3b336ec8a0e81ae812bd3e16627651c7837454d4b3cf56c2c1b"} May 21 11:46:59.547473 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:59.547433 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znxqq" event={"ID":"08beb4c2-4188-450b-b813-6f96a06a837c","Type":"ContainerStarted","Data":"0868bd6975555f329d7d1b3c4b76469ed37574c311bfd261736333af9f92900b"} May 21 11:46:59.547473 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:59.547478 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znxqq" event={"ID":"08beb4c2-4188-450b-b813-6f96a06a837c","Type":"ContainerStarted","Data":"a1fdb195afa08510765da42b79103f5d757397656f3bb466935d8dc13005de23"} May 21 11:46:59.574302 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:46:59.574252 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-znxqq" podStartSLOduration=253.387559707 podStartE2EDuration="4m14.574239867s" podCreationTimestamp="2026-05-21 11:42:45 +0000 UTC" firstStartedPulling="2026-05-21 11:46:57.918373821 +0000 UTC m=+252.683005769" lastFinishedPulling="2026-05-21 11:46:59.105053977 +0000 UTC m=+253.869685929" observedRunningTime="2026-05-21 11:46:59.572096567 +0000 UTC m=+254.336728539" watchObservedRunningTime="2026-05-21 11:46:59.574239867 +0000 UTC m=+254.338871838" May 21 11:47:26.295363 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:47:26.295321 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" podUID="d6e241b9-237c-47bc-93e3-096bbc8c6669" May 21 11:47:26.295363 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:47:26.295321 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2rdf9" podUID="65ef81f8-5858-4a2d-af9a-e6fb8f141d9a" May 21 11:47:26.295761 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:47:26.295337 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6hq25" podUID="7d10e4e6-6857-4ab9-81fd-9c31035a0de1" May 21 11:47:26.613379 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:26.613346 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:47:26.613564 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:26.613346 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rdf9" May 21 11:47:26.613564 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:26.613346 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:47:30.268541 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.268499 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:47:30.269134 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.268564 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:47:30.269134 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.268597 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:47:30.270978 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.270956 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65ef81f8-5858-4a2d-af9a-e6fb8f141d9a-metrics-tls\") pod \"dns-default-2rdf9\" (UID: \"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a\") " pod="openshift-dns/dns-default-2rdf9" May 21 11:47:30.271093 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.271011 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6e241b9-237c-47bc-93e3-096bbc8c6669-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gwf79\" (UID: \"d6e241b9-237c-47bc-93e3-096bbc8c6669\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:47:30.271093 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.271039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d10e4e6-6857-4ab9-81fd-9c31035a0de1-cert\") pod \"ingress-canary-6hq25\" (UID: \"7d10e4e6-6857-4ab9-81fd-9c31035a0de1\") " pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:47:30.517911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.517879 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zsdgm\"" May 21 11:47:30.517911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.517884 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6x8vn\"" May 21 11:47:30.518164 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.517936 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cwzz8\"" May 21 11:47:30.524089 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.524044 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" May 21 11:47:30.524089 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.524064 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hq25" May 21 11:47:30.524214 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.524064 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rdf9" May 21 11:47:30.667655 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.667623 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hq25"] May 21 11:47:30.673431 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:47:30.673394 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d10e4e6_6857_4ab9_81fd_9c31035a0de1.slice/crio-f53a29da34477a901d0e900ccfcf5f89959210c9c21034953fdca8819f1a4722 WatchSource:0}: Error finding container f53a29da34477a901d0e900ccfcf5f89959210c9c21034953fdca8819f1a4722: Status 404 returned error can't find the container with id f53a29da34477a901d0e900ccfcf5f89959210c9c21034953fdca8819f1a4722 May 21 11:47:30.889509 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.889482 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79"] May 21 11:47:30.892290 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:47:30.892169 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e241b9_237c_47bc_93e3_096bbc8c6669.slice/crio-b40e9b5f2b5f2d693c2233473af37c39ad752164bbcee381eda0f5dadd3f1250 WatchSource:0}: Error finding container b40e9b5f2b5f2d693c2233473af37c39ad752164bbcee381eda0f5dadd3f1250: Status 404 returned error can't find the container with id b40e9b5f2b5f2d693c2233473af37c39ad752164bbcee381eda0f5dadd3f1250 May 21 11:47:30.893449 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:30.893430 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rdf9"] May 21 11:47:30.895927 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:47:30.895899 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ef81f8_5858_4a2d_af9a_e6fb8f141d9a.slice/crio-ee923abd0865eeebbf5b9d8ca532c0ee9a37a6c113a08755aa7354a0b4dc7e28 WatchSource:0}: Error finding container ee923abd0865eeebbf5b9d8ca532c0ee9a37a6c113a08755aa7354a0b4dc7e28: Status 404 returned error can't find the container with id ee923abd0865eeebbf5b9d8ca532c0ee9a37a6c113a08755aa7354a0b4dc7e28 May 21 11:47:31.627929 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:31.627890 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hq25" event={"ID":"7d10e4e6-6857-4ab9-81fd-9c31035a0de1","Type":"ContainerStarted","Data":"f53a29da34477a901d0e900ccfcf5f89959210c9c21034953fdca8819f1a4722"} May 21 11:47:31.629463 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:31.629419 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" event={"ID":"d6e241b9-237c-47bc-93e3-096bbc8c6669","Type":"ContainerStarted","Data":"b40e9b5f2b5f2d693c2233473af37c39ad752164bbcee381eda0f5dadd3f1250"} May 21 11:47:31.631035 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:31.631007 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rdf9" event={"ID":"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a","Type":"ContainerStarted","Data":"ee923abd0865eeebbf5b9d8ca532c0ee9a37a6c113a08755aa7354a0b4dc7e28"} May 21 11:47:33.638717 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.638679 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" event={"ID":"d6e241b9-237c-47bc-93e3-096bbc8c6669","Type":"ContainerStarted","Data":"e52db955620318a1649b286c92cb0d4cb3a8ddccc9cbf114d1004106befd6e57"} May 21 11:47:33.640116 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.640089 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rdf9" event={"ID":"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a","Type":"ContainerStarted","Data":"13b7af395641d9db3a0f3b781a7ff13cfc5393a796e43195699bef33aad32d18"} May 21 11:47:33.640236 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.640129 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rdf9" event={"ID":"65ef81f8-5858-4a2d-af9a-e6fb8f141d9a","Type":"ContainerStarted","Data":"23f969832c99b26c9d16d33d7baced2421c24d19879ebff0c3c18f3b52d62c9a"} May 21 11:47:33.640236 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.640196 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2rdf9" May 21 11:47:33.641307 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.641290 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hq25" event={"ID":"7d10e4e6-6857-4ab9-81fd-9c31035a0de1","Type":"ContainerStarted","Data":"363e3f849d5141cbf984011497432a2bae6e1361a54ac39395e24974fd7e1096"} May 21 11:47:33.656463 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.656415 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gwf79" podStartSLOduration=261.553422012 podStartE2EDuration="4m23.656405025s" podCreationTimestamp="2026-05-21 11:43:10 +0000 UTC" firstStartedPulling="2026-05-21 11:47:30.894604387 +0000 UTC m=+285.659236336" lastFinishedPulling="2026-05-21 11:47:32.997587383 +0000 UTC m=+287.762219349" observedRunningTime="2026-05-21 11:47:33.655169675 +0000 UTC m=+288.419801646" watchObservedRunningTime="2026-05-21 11:47:33.656405025 +0000 UTC m=+288.421036995" May 21 11:47:33.675060 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.675020 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2rdf9" podStartSLOduration=251.571231484 podStartE2EDuration="4m13.675007476s" podCreationTimestamp="2026-05-21 11:43:20 +0000 UTC" firstStartedPulling="2026-05-21 11:47:30.897663785 +0000 UTC m=+285.662295734" lastFinishedPulling="2026-05-21 11:47:33.001439769 +0000 UTC m=+287.766071726" observedRunningTime="2026-05-21 11:47:33.673814677 +0000 UTC m=+288.438446649" watchObservedRunningTime="2026-05-21 11:47:33.675007476 +0000 UTC m=+288.439639446" May 21 11:47:33.692051 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:33.692011 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6hq25" podStartSLOduration=251.369082943 podStartE2EDuration="4m13.691999379s" podCreationTimestamp="2026-05-21 11:43:20 +0000 UTC" firstStartedPulling="2026-05-21 11:47:30.676570907 +0000 UTC m=+285.441202857" lastFinishedPulling="2026-05-21 11:47:32.999487338 +0000 UTC m=+287.764119293" observedRunningTime="2026-05-21 11:47:33.69113495 +0000 UTC m=+288.455766932" watchObservedRunningTime="2026-05-21 11:47:33.691999379 +0000 UTC m=+288.456631349" May 21 11:47:43.646673 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:43.646644 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2rdf9" May 21 11:47:45.762389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:47:45.762364 2557 kubelet.go:1628] "Image garbage collection succeeded" May 21 11:50:43.178494 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.178460 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp"] May 21 11:50:43.181417 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.181399 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.184082 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.184055 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 11:50:43.184082 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.184073 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4xn5q\"" May 21 11:50:43.184351 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.184337 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 11:50:43.199041 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.199017 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp"] May 21 11:50:43.279093 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.279062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f75f0b78-5583-484a-86ed-4907a5b0e99b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.279093 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.279095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rnjc\" (UniqueName: \"kubernetes.io/projected/f75f0b78-5583-484a-86ed-4907a5b0e99b-kube-api-access-8rnjc\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.379851 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.379818 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f75f0b78-5583-484a-86ed-4907a5b0e99b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.379851 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.379852 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rnjc\" (UniqueName: \"kubernetes.io/projected/f75f0b78-5583-484a-86ed-4907a5b0e99b-kube-api-access-8rnjc\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.380252 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.380229 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f75f0b78-5583-484a-86ed-4907a5b0e99b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.389316 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.389294 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rnjc\" (UniqueName: \"kubernetes.io/projected/f75f0b78-5583-484a-86ed-4907a5b0e99b-kube-api-access-8rnjc\") pod \"cert-manager-operator-controller-manager-54b9655956-z4pmp\" (UID: \"f75f0b78-5583-484a-86ed-4907a5b0e99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.490515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.490429 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" May 21 11:50:43.615957 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.615905 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp"] May 21 11:50:43.618792 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:50:43.618765 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75f0b78_5583_484a_86ed_4907a5b0e99b.slice/crio-c4607c3d343b17c2f53bcabc3493804163db90eaed278950cc9669472cc3feba WatchSource:0}: Error finding container c4607c3d343b17c2f53bcabc3493804163db90eaed278950cc9669472cc3feba: Status 404 returned error can't find the container with id c4607c3d343b17c2f53bcabc3493804163db90eaed278950cc9669472cc3feba May 21 11:50:43.621146 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:43.621129 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:50:44.112392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:44.112361 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" event={"ID":"f75f0b78-5583-484a-86ed-4907a5b0e99b","Type":"ContainerStarted","Data":"c4607c3d343b17c2f53bcabc3493804163db90eaed278950cc9669472cc3feba"} May 21 11:50:46.119244 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:46.119203 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" event={"ID":"f75f0b78-5583-484a-86ed-4907a5b0e99b","Type":"ContainerStarted","Data":"29f88c7df4241c2569bd99f342b7590d7e790108b6d5ad39c09114aa4e1327e1"} May 21 11:50:46.150248 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:50:46.150196 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-z4pmp" podStartSLOduration=1.423587208 podStartE2EDuration="3.150182887s" podCreationTimestamp="2026-05-21 11:50:43 +0000 UTC" firstStartedPulling="2026-05-21 11:50:43.621257364 +0000 UTC m=+478.385889312" lastFinishedPulling="2026-05-21 11:50:45.347853042 +0000 UTC m=+480.112484991" observedRunningTime="2026-05-21 11:50:46.148681648 +0000 UTC m=+480.913313630" watchObservedRunningTime="2026-05-21 11:50:46.150182887 +0000 UTC m=+480.914814858" May 21 11:51:24.885496 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.885451 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt"] May 21 11:51:24.888506 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.888479 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:24.891601 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.891576 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 11:51:24.891748 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.891731 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 11:51:24.891820 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.891755 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2hcz8\"" May 21 11:51:24.891820 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.891765 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 11:51:24.892063 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.892049 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 11:51:24.905018 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:24.904990 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt"] May 21 11:51:25.082291 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.082246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.082291 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.082312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.082562 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.082345 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5bx6\" (UniqueName: \"kubernetes.io/projected/aa0c4197-11ed-425f-9d32-d2871256d2ad-kube-api-access-m5bx6\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.183027 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.182917 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5bx6\" (UniqueName: \"kubernetes.io/projected/aa0c4197-11ed-425f-9d32-d2871256d2ad-kube-api-access-m5bx6\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.183027 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.183015 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.183209 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.183047 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.185611 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.185589 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.185668 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.185615 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0c4197-11ed-425f-9d32-d2871256d2ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.191716 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.191692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5bx6\" (UniqueName: \"kubernetes.io/projected/aa0c4197-11ed-425f-9d32-d2871256d2ad-kube-api-access-m5bx6\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-jsgpt\" (UID: \"aa0c4197-11ed-425f-9d32-d2871256d2ad\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.198432 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.198410 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:25.324667 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:25.324633 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt"] May 21 11:51:25.328332 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:51:25.328292 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0c4197_11ed_425f_9d32_d2871256d2ad.slice/crio-2ea67b8ccda40570b5739f9021235aef13417f1e98d39996d70f3f9552fa5d73 WatchSource:0}: Error finding container 2ea67b8ccda40570b5739f9021235aef13417f1e98d39996d70f3f9552fa5d73: Status 404 returned error can't find the container with id 2ea67b8ccda40570b5739f9021235aef13417f1e98d39996d70f3f9552fa5d73 May 21 11:51:26.227666 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:26.227629 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" event={"ID":"aa0c4197-11ed-425f-9d32-d2871256d2ad","Type":"ContainerStarted","Data":"2ea67b8ccda40570b5739f9021235aef13417f1e98d39996d70f3f9552fa5d73"} May 21 11:51:28.234964 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:28.234875 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" event={"ID":"aa0c4197-11ed-425f-9d32-d2871256d2ad","Type":"ContainerStarted","Data":"0ad5275a1ed3fcfd2b6e80b9bd766e79d9111a3475e7bc941554651073563e00"} May 21 11:51:28.235348 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:28.235017 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:28.263696 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:28.263641 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" podStartSLOduration=1.674916218 podStartE2EDuration="4.263626775s" podCreationTimestamp="2026-05-21 11:51:24 +0000 UTC" firstStartedPulling="2026-05-21 11:51:25.330051291 +0000 UTC m=+520.094683255" lastFinishedPulling="2026-05-21 11:51:27.918761863 +0000 UTC m=+522.683393812" observedRunningTime="2026-05-21 11:51:28.2628247 +0000 UTC m=+523.027456670" watchObservedRunningTime="2026-05-21 11:51:28.263626775 +0000 UTC m=+523.028258746" May 21 11:51:31.655246 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.655211 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m"] May 21 11:51:31.658459 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.658442 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.661978 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.661955 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 11:51:31.663131 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.663110 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jvcqh\"" May 21 11:51:31.663131 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.663124 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 11:51:31.663350 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.663113 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 11:51:31.663350 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.663200 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 11:51:31.663619 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.663592 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 11:51:31.678792 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.678760 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m"] May 21 11:51:31.725814 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.725776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-metrics-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.726034 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.725841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/473b37c0-6b26-42be-a818-611b0df874cb-manager-config\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.726034 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.725922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.726034 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.725955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpp57\" (UniqueName: \"kubernetes.io/projected/473b37c0-6b26-42be-a818-611b0df874cb-kube-api-access-kpp57\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.826642 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.826604 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.826642 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.826649 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpp57\" (UniqueName: \"kubernetes.io/projected/473b37c0-6b26-42be-a818-611b0df874cb-kube-api-access-kpp57\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.826930 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.826775 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-metrics-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.826930 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.826841 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/473b37c0-6b26-42be-a818-611b0df874cb-manager-config\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.827494 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.827473 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/473b37c0-6b26-42be-a818-611b0df874cb-manager-config\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.829226 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.829200 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-metrics-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.829305 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.829278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473b37c0-6b26-42be-a818-611b0df874cb-cert\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.839759 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.839730 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpp57\" (UniqueName: \"kubernetes.io/projected/473b37c0-6b26-42be-a818-611b0df874cb-kube-api-access-kpp57\") pod \"lws-controller-manager-6754f9fdfc-w7w2m\" (UID: \"473b37c0-6b26-42be-a818-611b0df874cb\") " pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:31.967838 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:31.967749 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:32.114989 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:32.114955 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m"] May 21 11:51:32.118122 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:51:32.118084 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473b37c0_6b26_42be_a818_611b0df874cb.slice/crio-8488961efec197251b55990854fc391d1f79857959ee40b82d933cf0b3ec36cc WatchSource:0}: Error finding container 8488961efec197251b55990854fc391d1f79857959ee40b82d933cf0b3ec36cc: Status 404 returned error can't find the container with id 8488961efec197251b55990854fc391d1f79857959ee40b82d933cf0b3ec36cc May 21 11:51:32.247506 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:32.247423 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" event={"ID":"473b37c0-6b26-42be-a818-611b0df874cb","Type":"ContainerStarted","Data":"8488961efec197251b55990854fc391d1f79857959ee40b82d933cf0b3ec36cc"} May 21 11:51:35.257710 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:35.257671 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" event={"ID":"473b37c0-6b26-42be-a818-611b0df874cb","Type":"ContainerStarted","Data":"b21e345fb61d18b7f01a8a064b4ae05e24279c2585bfdb43f70629062c632bbc"} May 21 11:51:35.258127 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:35.257899 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:35.278034 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:35.277977 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" podStartSLOduration=1.710744099 podStartE2EDuration="4.277962997s" podCreationTimestamp="2026-05-21 11:51:31 +0000 UTC" firstStartedPulling="2026-05-21 11:51:32.11990147 +0000 UTC m=+526.884533419" lastFinishedPulling="2026-05-21 11:51:34.687120365 +0000 UTC m=+529.451752317" observedRunningTime="2026-05-21 11:51:35.276244808 +0000 UTC m=+530.040876779" watchObservedRunningTime="2026-05-21 11:51:35.277962997 +0000 UTC m=+530.042594967" May 21 11:51:39.240046 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:39.240006 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-jsgpt" May 21 11:51:43.408606 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.408573 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz"] May 21 11:51:43.411624 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.411607 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.415891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.415843 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t5slm\"" May 21 11:51:43.415891 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.415886 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 11:51:43.416062 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.415843 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 11:51:43.416062 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.415873 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 11:51:43.416062 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.415934 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 11:51:43.420186 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.420164 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz"] May 21 11:51:43.516334 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.516291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkcr\" (UniqueName: \"kubernetes.io/projected/9cd60be9-c576-4041-8ee0-ab4ccffb2544-kube-api-access-npkcr\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.516334 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.516335 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tmp\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.516534 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.516366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.617190 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.617148 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npkcr\" (UniqueName: \"kubernetes.io/projected/9cd60be9-c576-4041-8ee0-ab4ccffb2544-kube-api-access-npkcr\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.617190 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.617189 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tmp\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.617392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.617225 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.619590 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.619565 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tmp\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.619718 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.619699 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd60be9-c576-4041-8ee0-ab4ccffb2544-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.626903 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.626879 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkcr\" (UniqueName: \"kubernetes.io/projected/9cd60be9-c576-4041-8ee0-ab4ccffb2544-kube-api-access-npkcr\") pod \"kube-auth-proxy-ff9d596fb-ct9mz\" (UID: \"9cd60be9-c576-4041-8ee0-ab4ccffb2544\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.721213 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.721115 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" May 21 11:51:43.853190 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:43.853165 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz"] May 21 11:51:43.855634 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:51:43.855603 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd60be9_c576_4041_8ee0_ab4ccffb2544.slice/crio-eeb9b7e645ff08d7617eb47e7ca2e96447e0f47ec0b04ef842390886bda8bcbb WatchSource:0}: Error finding container eeb9b7e645ff08d7617eb47e7ca2e96447e0f47ec0b04ef842390886bda8bcbb: Status 404 returned error can't find the container with id eeb9b7e645ff08d7617eb47e7ca2e96447e0f47ec0b04ef842390886bda8bcbb May 21 11:51:44.284744 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:44.284706 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" event={"ID":"9cd60be9-c576-4041-8ee0-ab4ccffb2544","Type":"ContainerStarted","Data":"eeb9b7e645ff08d7617eb47e7ca2e96447e0f47ec0b04ef842390886bda8bcbb"} May 21 11:51:46.262829 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:46.262800 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6754f9fdfc-w7w2m" May 21 11:51:46.812393 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:46.812369 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 11:51:47.298384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:47.298346 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" event={"ID":"9cd60be9-c576-4041-8ee0-ab4ccffb2544","Type":"ContainerStarted","Data":"be062d4d1814689e057df8b515e1c2173bacd7ed4625232ad3155aadd6f1b193"} May 21 11:51:47.316535 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:51:47.316483 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-ct9mz" podStartSLOduration=1.364060281 podStartE2EDuration="4.316467259s" podCreationTimestamp="2026-05-21 11:51:43 +0000 UTC" firstStartedPulling="2026-05-21 11:51:43.857331404 +0000 UTC m=+538.621963358" lastFinishedPulling="2026-05-21 11:51:46.809738372 +0000 UTC m=+541.574370336" observedRunningTime="2026-05-21 11:51:47.315594557 +0000 UTC m=+542.080226531" watchObservedRunningTime="2026-05-21 11:51:47.316467259 +0000 UTC m=+542.081099229" May 21 11:53:28.220467 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.220435 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk"] May 21 11:53:28.223733 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.223717 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.228333 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.228310 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 11:53:28.228475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.228347 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 11:53:28.228475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.228358 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 11:53:28.228946 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.228930 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 11:53:28.229652 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.229633 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwvqw\"" May 21 11:53:28.259335 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.259309 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk"] May 21 11:53:28.300396 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.300354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/22fc59c6-9953-4efa-b6de-30900b1b58e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.300575 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.300423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22fc59c6-9953-4efa-b6de-30900b1b58e2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.300575 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.300445 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwc2\" (UniqueName: \"kubernetes.io/projected/22fc59c6-9953-4efa-b6de-30900b1b58e2-kube-api-access-lgwc2\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.400810 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.400776 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22fc59c6-9953-4efa-b6de-30900b1b58e2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.400810 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.400814 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwc2\" (UniqueName: \"kubernetes.io/projected/22fc59c6-9953-4efa-b6de-30900b1b58e2-kube-api-access-lgwc2\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.401059 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.400976 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/22fc59c6-9953-4efa-b6de-30900b1b58e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.401476 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.401450 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22fc59c6-9953-4efa-b6de-30900b1b58e2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.403372 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.403346 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/22fc59c6-9953-4efa-b6de-30900b1b58e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.419814 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.419787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwc2\" (UniqueName: \"kubernetes.io/projected/22fc59c6-9953-4efa-b6de-30900b1b58e2-kube-api-access-lgwc2\") pod \"kuadrant-console-plugin-6cb54b5c86-67ckk\" (UID: \"22fc59c6-9953-4efa-b6de-30900b1b58e2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.533042 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.532960 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" May 21 11:53:28.677723 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:28.677700 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk"] May 21 11:53:28.679388 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:53:28.679362 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22fc59c6_9953_4efa_b6de_30900b1b58e2.slice/crio-484a659f9737f8b755f5becff63b7a225e04f6cb048b709debf0e7946c2c458e WatchSource:0}: Error finding container 484a659f9737f8b755f5becff63b7a225e04f6cb048b709debf0e7946c2c458e: Status 404 returned error can't find the container with id 484a659f9737f8b755f5becff63b7a225e04f6cb048b709debf0e7946c2c458e May 21 11:53:29.609450 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:29.609412 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" event={"ID":"22fc59c6-9953-4efa-b6de-30900b1b58e2","Type":"ContainerStarted","Data":"484a659f9737f8b755f5becff63b7a225e04f6cb048b709debf0e7946c2c458e"} May 21 11:53:52.686265 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:52.686227 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" event={"ID":"22fc59c6-9953-4efa-b6de-30900b1b58e2","Type":"ContainerStarted","Data":"79061bae2a5ee48e4d998de312711cc02c71058f6ad1d6a1aecfdc3ac21269ce"} May 21 11:53:52.710913 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:53:52.710849 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-67ckk" podStartSLOduration=1.605246128 podStartE2EDuration="24.710834703s" podCreationTimestamp="2026-05-21 11:53:28 +0000 UTC" firstStartedPulling="2026-05-21 11:53:28.680648676 +0000 UTC m=+643.445280626" lastFinishedPulling="2026-05-21 11:53:51.786237252 +0000 UTC m=+666.550869201" observedRunningTime="2026-05-21 11:53:52.710270478 +0000 UTC m=+667.474902450" watchObservedRunningTime="2026-05-21 11:53:52.710834703 +0000 UTC m=+667.475466708" May 21 11:54:17.069427 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.069376 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:17.088272 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.088239 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:17.088447 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.088388 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:17.095176 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.095151 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q69cw\"" May 21 11:54:17.163184 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.163141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwzf\" (UniqueName: \"kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf\") pod \"authorino-f99f4b5cd-xsjtw\" (UID: \"c485e7cd-7c0d-4081-9e1f-912e81986390\") " pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:17.263944 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.263892 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwzf\" (UniqueName: \"kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf\") pod \"authorino-f99f4b5cd-xsjtw\" (UID: \"c485e7cd-7c0d-4081-9e1f-912e81986390\") " pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:17.273039 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.273013 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwzf\" (UniqueName: \"kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf\") pod \"authorino-f99f4b5cd-xsjtw\" (UID: \"c485e7cd-7c0d-4081-9e1f-912e81986390\") " pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:17.327306 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.327224 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:17.330493 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.330475 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:17.338410 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.338378 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:17.365287 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.365255 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmp8j\" (UniqueName: \"kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j\") pod \"authorino-7498df8756-5htds\" (UID: \"6ab66d5c-7fb3-4738-bd55-cc24298f2931\") " pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:17.397275 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.397241 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:17.466147 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.466112 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmp8j\" (UniqueName: \"kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j\") pod \"authorino-7498df8756-5htds\" (UID: \"6ab66d5c-7fb3-4738-bd55-cc24298f2931\") " pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:17.474793 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.474763 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmp8j\" (UniqueName: \"kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j\") pod \"authorino-7498df8756-5htds\" (UID: \"6ab66d5c-7fb3-4738-bd55-cc24298f2931\") " pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:17.521695 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.521595 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:17.524521 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:54:17.524491 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc485e7cd_7c0d_4081_9e1f_912e81986390.slice/crio-e0ade31b914eb294fdc50742e8e5b2f813bd35c74320f02bc856981e6d85ebcf WatchSource:0}: Error finding container e0ade31b914eb294fdc50742e8e5b2f813bd35c74320f02bc856981e6d85ebcf: Status 404 returned error can't find the container with id e0ade31b914eb294fdc50742e8e5b2f813bd35c74320f02bc856981e6d85ebcf May 21 11:54:17.640327 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.640296 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:17.764058 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.764013 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:17.770765 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:54:17.770734 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ab66d5c_7fb3_4738_bd55_cc24298f2931.slice/crio-3592436dc9eb1d8daaa5d970848c0787c7a2ccf39462987a0ddab1a808ecf1fc WatchSource:0}: Error finding container 3592436dc9eb1d8daaa5d970848c0787c7a2ccf39462987a0ddab1a808ecf1fc: Status 404 returned error can't find the container with id 3592436dc9eb1d8daaa5d970848c0787c7a2ccf39462987a0ddab1a808ecf1fc May 21 11:54:17.771601 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:17.771570 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" event={"ID":"c485e7cd-7c0d-4081-9e1f-912e81986390","Type":"ContainerStarted","Data":"e0ade31b914eb294fdc50742e8e5b2f813bd35c74320f02bc856981e6d85ebcf"} May 21 11:54:18.780049 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:18.779976 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5htds" event={"ID":"6ab66d5c-7fb3-4738-bd55-cc24298f2931","Type":"ContainerStarted","Data":"3592436dc9eb1d8daaa5d970848c0787c7a2ccf39462987a0ddab1a808ecf1fc"} May 21 11:54:21.794385 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:21.794345 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5htds" event={"ID":"6ab66d5c-7fb3-4738-bd55-cc24298f2931","Type":"ContainerStarted","Data":"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6"} May 21 11:54:21.795652 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:21.795627 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" event={"ID":"c485e7cd-7c0d-4081-9e1f-912e81986390","Type":"ContainerStarted","Data":"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5"} May 21 11:54:21.812074 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:21.812024 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-5htds" podStartSLOduration=1.5785890500000002 podStartE2EDuration="4.812009036s" podCreationTimestamp="2026-05-21 11:54:17 +0000 UTC" firstStartedPulling="2026-05-21 11:54:17.771725671 +0000 UTC m=+692.536357619" lastFinishedPulling="2026-05-21 11:54:21.005145656 +0000 UTC m=+695.769777605" observedRunningTime="2026-05-21 11:54:21.810190234 +0000 UTC m=+696.574822205" watchObservedRunningTime="2026-05-21 11:54:21.812009036 +0000 UTC m=+696.576641004" May 21 11:54:21.827125 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:21.827079 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" podStartSLOduration=1.360333436 podStartE2EDuration="4.827063087s" podCreationTimestamp="2026-05-21 11:54:17 +0000 UTC" firstStartedPulling="2026-05-21 11:54:17.526188787 +0000 UTC m=+692.290820736" lastFinishedPulling="2026-05-21 11:54:20.992918438 +0000 UTC m=+695.757550387" observedRunningTime="2026-05-21 11:54:21.825465536 +0000 UTC m=+696.590097506" watchObservedRunningTime="2026-05-21 11:54:21.827063087 +0000 UTC m=+696.591695058" May 21 11:54:21.854315 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:21.854270 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:23.801563 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:23.801498 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" podUID="c485e7cd-7c0d-4081-9e1f-912e81986390" containerName="authorino" containerID="cri-o://4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5" gracePeriod=30 May 21 11:54:24.034198 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.034177 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:24.123187 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.123160 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jwzf\" (UniqueName: \"kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf\") pod \"c485e7cd-7c0d-4081-9e1f-912e81986390\" (UID: \"c485e7cd-7c0d-4081-9e1f-912e81986390\") " May 21 11:54:24.125298 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.125269 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf" (OuterVolumeSpecName: "kube-api-access-9jwzf") pod "c485e7cd-7c0d-4081-9e1f-912e81986390" (UID: "c485e7cd-7c0d-4081-9e1f-912e81986390"). InnerVolumeSpecName "kube-api-access-9jwzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:24.224620 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.224583 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jwzf\" (UniqueName: \"kubernetes.io/projected/c485e7cd-7c0d-4081-9e1f-912e81986390-kube-api-access-9jwzf\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:54:24.806038 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.805991 2557 generic.go:358] "Generic (PLEG): container finished" podID="c485e7cd-7c0d-4081-9e1f-912e81986390" containerID="4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5" exitCode=0 May 21 11:54:24.806475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.806053 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" event={"ID":"c485e7cd-7c0d-4081-9e1f-912e81986390","Type":"ContainerDied","Data":"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5"} May 21 11:54:24.806475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.806084 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" event={"ID":"c485e7cd-7c0d-4081-9e1f-912e81986390","Type":"ContainerDied","Data":"e0ade31b914eb294fdc50742e8e5b2f813bd35c74320f02bc856981e6d85ebcf"} May 21 11:54:24.806475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.806100 2557 scope.go:117] "RemoveContainer" containerID="4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5" May 21 11:54:24.806475 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.806058 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xsjtw" May 21 11:54:24.813809 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.813625 2557 scope.go:117] "RemoveContainer" containerID="4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5" May 21 11:54:24.814086 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:54:24.814059 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5\": container with ID starting with 4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5 not found: ID does not exist" containerID="4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5" May 21 11:54:24.814176 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.814095 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5"} err="failed to get container status \"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5\": rpc error: code = NotFound desc = could not find container \"4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5\": container with ID starting with 4744d4b6db6e8c73ebd6647473e96cf537c0c371bb556e308a460026fa84d8e5 not found: ID does not exist" May 21 11:54:24.826744 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.826720 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:24.830613 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:24.830581 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xsjtw"] May 21 11:54:25.873271 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:25.873227 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c485e7cd-7c0d-4081-9e1f-912e81986390" path="/var/lib/kubelet/pods/c485e7cd-7c0d-4081-9e1f-912e81986390/volumes" May 21 11:54:45.139174 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.139081 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zqkr9"] May 21 11:54:45.139697 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.139486 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c485e7cd-7c0d-4081-9e1f-912e81986390" containerName="authorino" May 21 11:54:45.139697 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.139503 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c485e7cd-7c0d-4081-9e1f-912e81986390" containerName="authorino" May 21 11:54:45.139697 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.139594 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c485e7cd-7c0d-4081-9e1f-912e81986390" containerName="authorino" May 21 11:54:45.142462 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.142440 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.155384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.155355 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zqkr9"] May 21 11:54:45.295222 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.295184 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j6kf\" (UniqueName: \"kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf\") pod \"authorino-8b475cf9f-zqkr9\" (UID: \"1b13bd29-bc46-48fe-b338-0e34130b5554\") " pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.332073 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.332036 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zqkr9"] May 21 11:54:45.332256 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:54:45.332237 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5j6kf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-zqkr9" podUID="1b13bd29-bc46-48fe-b338-0e34130b5554" May 21 11:54:45.357681 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.357630 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-cr8rw"] May 21 11:54:45.360683 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.360661 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.363469 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.363451 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 11:54:45.368675 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.368643 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-cr8rw"] May 21 11:54:45.396701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.396614 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5j6kf\" (UniqueName: \"kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf\") pod \"authorino-8b475cf9f-zqkr9\" (UID: \"1b13bd29-bc46-48fe-b338-0e34130b5554\") " pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.405400 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.405375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j6kf\" (UniqueName: \"kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf\") pod \"authorino-8b475cf9f-zqkr9\" (UID: \"1b13bd29-bc46-48fe-b338-0e34130b5554\") " pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.417069 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.417041 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-cr8rw"] May 21 11:54:45.417262 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:54:45.417243 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sthdp tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-sthdp tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-cr8rw" podUID="52ccb89a-64db-48cb-a73b-4caf121f9360" May 21 11:54:45.444584 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.444557 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:54:45.447706 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.447690 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.457449 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.457428 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:54:45.497528 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.497488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.497715 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.497609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthdp\" (UniqueName: \"kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.598420 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.598385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.598593 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.598450 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sthdp\" (UniqueName: \"kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.598593 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.598513 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvnm\" (UniqueName: \"kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.598593 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.598575 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.601005 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.600981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.607887 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.607847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthdp\" (UniqueName: \"kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp\") pod \"authorino-56fdd757f5-cr8rw\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.699259 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.699172 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.699259 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.699230 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvnm\" (UniqueName: \"kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.701603 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.701576 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.708138 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.708104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvnm\" (UniqueName: \"kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm\") pod \"authorino-776c87846-4mchd\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.756871 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.756837 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:54:45.868221 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.868192 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.868221 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.868212 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.873854 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.873822 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:45.876236 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.876217 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:45.879218 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:45.879194 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:54:45.882190 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:54:45.882164 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0db41b6_dbd0_436a_b832_ccec5d9b76b4.slice/crio-5159a90d51eb90cd2bfaea6feae09a08984b9455663aff0ce96c95084ca56d3b WatchSource:0}: Error finding container 5159a90d51eb90cd2bfaea6feae09a08984b9455663aff0ce96c95084ca56d3b: Status 404 returned error can't find the container with id 5159a90d51eb90cd2bfaea6feae09a08984b9455663aff0ce96c95084ca56d3b May 21 11:54:46.001416 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.001328 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j6kf\" (UniqueName: \"kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf\") pod \"1b13bd29-bc46-48fe-b338-0e34130b5554\" (UID: \"1b13bd29-bc46-48fe-b338-0e34130b5554\") " May 21 11:54:46.001416 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.001367 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert\") pod \"52ccb89a-64db-48cb-a73b-4caf121f9360\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " May 21 11:54:46.001634 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.001501 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sthdp\" (UniqueName: \"kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp\") pod \"52ccb89a-64db-48cb-a73b-4caf121f9360\" (UID: \"52ccb89a-64db-48cb-a73b-4caf121f9360\") " May 21 11:54:46.003410 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.003376 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf" (OuterVolumeSpecName: "kube-api-access-5j6kf") pod "1b13bd29-bc46-48fe-b338-0e34130b5554" (UID: "1b13bd29-bc46-48fe-b338-0e34130b5554"). InnerVolumeSpecName "kube-api-access-5j6kf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:46.003410 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.003388 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp" (OuterVolumeSpecName: "kube-api-access-sthdp") pod "52ccb89a-64db-48cb-a73b-4caf121f9360" (UID: "52ccb89a-64db-48cb-a73b-4caf121f9360"). InnerVolumeSpecName "kube-api-access-sthdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:46.003554 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.003429 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "52ccb89a-64db-48cb-a73b-4caf121f9360" (UID: "52ccb89a-64db-48cb-a73b-4caf121f9360"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:54:46.102634 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.102603 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j6kf\" (UniqueName: \"kubernetes.io/projected/1b13bd29-bc46-48fe-b338-0e34130b5554-kube-api-access-5j6kf\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:54:46.102634 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.102631 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/52ccb89a-64db-48cb-a73b-4caf121f9360-tls-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:54:46.102634 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.102643 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sthdp\" (UniqueName: \"kubernetes.io/projected/52ccb89a-64db-48cb-a73b-4caf121f9360-kube-api-access-sthdp\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:54:46.873146 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.873102 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-776c87846-4mchd" event={"ID":"d0db41b6-dbd0-436a-b832-ccec5d9b76b4","Type":"ContainerStarted","Data":"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5"} May 21 11:54:46.873146 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.873149 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-776c87846-4mchd" event={"ID":"d0db41b6-dbd0-436a-b832-ccec5d9b76b4","Type":"ContainerStarted","Data":"5159a90d51eb90cd2bfaea6feae09a08984b9455663aff0ce96c95084ca56d3b"} May 21 11:54:46.873546 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.873210 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-cr8rw" May 21 11:54:46.873546 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.873239 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zqkr9" May 21 11:54:46.889544 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.889491 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-776c87846-4mchd" podStartSLOduration=1.554935615 podStartE2EDuration="1.889471047s" podCreationTimestamp="2026-05-21 11:54:45 +0000 UTC" firstStartedPulling="2026-05-21 11:54:45.88339978 +0000 UTC m=+720.648031729" lastFinishedPulling="2026-05-21 11:54:46.2179352 +0000 UTC m=+720.982567161" observedRunningTime="2026-05-21 11:54:46.888210929 +0000 UTC m=+721.652842899" watchObservedRunningTime="2026-05-21 11:54:46.889471047 +0000 UTC m=+721.654103018" May 21 11:54:46.915415 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.915377 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-cr8rw"] May 21 11:54:46.919458 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.919430 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-cr8rw"] May 21 11:54:46.922227 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.922204 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:46.922445 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.922423 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-5htds" podUID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" containerName="authorino" containerID="cri-o://f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6" gracePeriod=30 May 21 11:54:46.941965 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.941937 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zqkr9"] May 21 11:54:46.946414 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:46.946388 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zqkr9"] May 21 11:54:47.167109 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.167084 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:47.313751 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.313717 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmp8j\" (UniqueName: \"kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j\") pod \"6ab66d5c-7fb3-4738-bd55-cc24298f2931\" (UID: \"6ab66d5c-7fb3-4738-bd55-cc24298f2931\") " May 21 11:54:47.315800 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.315771 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j" (OuterVolumeSpecName: "kube-api-access-hmp8j") pod "6ab66d5c-7fb3-4738-bd55-cc24298f2931" (UID: "6ab66d5c-7fb3-4738-bd55-cc24298f2931"). InnerVolumeSpecName "kube-api-access-hmp8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:47.414951 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.414876 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmp8j\" (UniqueName: \"kubernetes.io/projected/6ab66d5c-7fb3-4738-bd55-cc24298f2931-kube-api-access-hmp8j\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:54:47.872763 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.872735 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b13bd29-bc46-48fe-b338-0e34130b5554" path="/var/lib/kubelet/pods/1b13bd29-bc46-48fe-b338-0e34130b5554/volumes" May 21 11:54:47.873021 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.873008 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ccb89a-64db-48cb-a73b-4caf121f9360" path="/var/lib/kubelet/pods/52ccb89a-64db-48cb-a73b-4caf121f9360/volumes" May 21 11:54:47.876460 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.876429 2557 generic.go:358] "Generic (PLEG): container finished" podID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" containerID="f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6" exitCode=0 May 21 11:54:47.876920 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.876477 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5htds" May 21 11:54:47.876920 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.876503 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5htds" event={"ID":"6ab66d5c-7fb3-4738-bd55-cc24298f2931","Type":"ContainerDied","Data":"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6"} May 21 11:54:47.876920 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.876540 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5htds" event={"ID":"6ab66d5c-7fb3-4738-bd55-cc24298f2931","Type":"ContainerDied","Data":"3592436dc9eb1d8daaa5d970848c0787c7a2ccf39462987a0ddab1a808ecf1fc"} May 21 11:54:47.876920 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.876556 2557 scope.go:117] "RemoveContainer" containerID="f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6" May 21 11:54:47.884582 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.884563 2557 scope.go:117] "RemoveContainer" containerID="f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6" May 21 11:54:47.884914 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:54:47.884892 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6\": container with ID starting with f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6 not found: ID does not exist" containerID="f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6" May 21 11:54:47.884989 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.884921 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6"} err="failed to get container status \"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6\": rpc error: code = NotFound desc = could not find container \"f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6\": container with ID starting with f6753a72467a686d00d79c8793a38c5995de885127dcb3fbbcd25413d5d9aeb6 not found: ID does not exist" May 21 11:54:47.899546 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.899518 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:47.903331 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:47.903305 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-5htds"] May 21 11:54:49.873023 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:54:49.872994 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" path="/var/lib/kubelet/pods/6ab66d5c-7fb3-4738-bd55-cc24298f2931/volumes" May 21 11:56:03.629075 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.628991 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz"] May 21 11:56:03.629693 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.629248 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" containerName="authorino" May 21 11:56:03.629693 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.629258 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" containerName="authorino" May 21 11:56:03.629693 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.629301 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ab66d5c-7fb3-4738-bd55-cc24298f2931" containerName="authorino" May 21 11:56:03.633205 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.633188 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.636290 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.636267 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cd26v\"" May 21 11:56:03.637566 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.637542 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 11:56:03.637674 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.637575 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 11:56:03.637674 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.637616 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 11:56:03.643095 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.643073 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz"] May 21 11:56:03.784734 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqxb\" (UniqueName: \"kubernetes.io/projected/e3196fe2-daa8-44d9-8a06-020437887c11-kube-api-access-wsqxb\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.784734 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.785013 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.785013 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196fe2-daa8-44d9-8a06-020437887c11-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.785013 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.785013 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.784932 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885296 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885337 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885384 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885375 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196fe2-daa8-44d9-8a06-020437887c11-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885580 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885393 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885580 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885418 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885580 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885449 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqxb\" (UniqueName: \"kubernetes.io/projected/e3196fe2-daa8-44d9-8a06-020437887c11-kube-api-access-wsqxb\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885835 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885799 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885938 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.885938 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.885909 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.887781 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.887755 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196fe2-daa8-44d9-8a06-020437887c11-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.887953 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.887937 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196fe2-daa8-44d9-8a06-020437887c11-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.900006 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.899983 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqxb\" (UniqueName: \"kubernetes.io/projected/e3196fe2-daa8-44d9-8a06-020437887c11-kube-api-access-wsqxb\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz\" (UID: \"e3196fe2-daa8-44d9-8a06-020437887c11\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:03.943958 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:03.943921 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:04.068027 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:04.067993 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz"] May 21 11:56:04.071658 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:56:04.071633 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3196fe2_daa8_44d9_8a06_020437887c11.slice/crio-66f55a9b6eb7908eadf0be8e4c940a66dcf51b9f168ed633c615fc0edcd2e4bd WatchSource:0}: Error finding container 66f55a9b6eb7908eadf0be8e4c940a66dcf51b9f168ed633c615fc0edcd2e4bd: Status 404 returned error can't find the container with id 66f55a9b6eb7908eadf0be8e4c940a66dcf51b9f168ed633c615fc0edcd2e4bd May 21 11:56:04.073310 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:04.073294 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:56:04.115008 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:04.114966 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" event={"ID":"e3196fe2-daa8-44d9-8a06-020437887c11","Type":"ContainerStarted","Data":"66f55a9b6eb7908eadf0be8e4c940a66dcf51b9f168ed633c615fc0edcd2e4bd"} May 21 11:56:10.137404 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:10.137366 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" event={"ID":"e3196fe2-daa8-44d9-8a06-020437887c11","Type":"ContainerStarted","Data":"01dc31aaf2b2e474e9834606fbafb658603e144334096236f3eb4f551427dfa6"} May 21 11:56:16.157295 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:16.157256 2557 generic.go:358] "Generic (PLEG): container finished" podID="e3196fe2-daa8-44d9-8a06-020437887c11" containerID="01dc31aaf2b2e474e9834606fbafb658603e144334096236f3eb4f551427dfa6" exitCode=0 May 21 11:56:16.157760 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:16.157305 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" event={"ID":"e3196fe2-daa8-44d9-8a06-020437887c11","Type":"ContainerDied","Data":"01dc31aaf2b2e474e9834606fbafb658603e144334096236f3eb4f551427dfa6"} May 21 11:56:18.165612 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:18.165577 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" event={"ID":"e3196fe2-daa8-44d9-8a06-020437887c11","Type":"ContainerStarted","Data":"451855b32d5026c23d561a5f887ddcfcfa9142d14445f40b3d2553d55e03b586"} May 21 11:56:18.166118 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:18.165808 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:18.187362 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:18.187310 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" podStartSLOduration=1.898182885 podStartE2EDuration="15.187292279s" podCreationTimestamp="2026-05-21 11:56:03 +0000 UTC" firstStartedPulling="2026-05-21 11:56:04.07341958 +0000 UTC m=+798.838051528" lastFinishedPulling="2026-05-21 11:56:17.362528958 +0000 UTC m=+812.127160922" observedRunningTime="2026-05-21 11:56:18.18556231 +0000 UTC m=+812.950194292" watchObservedRunningTime="2026-05-21 11:56:18.187292279 +0000 UTC m=+812.951924251" May 21 11:56:29.181320 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:29.181292 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz" May 21 11:56:49.822416 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.822384 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc"] May 21 11:56:49.826414 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.826385 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.829482 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.829459 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 11:56:49.834538 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.834502 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc"] May 21 11:56:49.941030 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.940999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.941183 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.941034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.941183 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.941113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.941272 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.941199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.941272 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.941252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86eddfbd-6fe9-4278-8f66-9af507f0afa3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:49.941358 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:49.941309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nkzg\" (UniqueName: \"kubernetes.io/projected/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kube-api-access-4nkzg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042312 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042272 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042462 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042340 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042462 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042430 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86eddfbd-6fe9-4278-8f66-9af507f0afa3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042565 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042461 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nkzg\" (UniqueName: \"kubernetes.io/projected/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kube-api-access-4nkzg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042565 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042513 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042565 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042541 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042720 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042695 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042828 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042808 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.042913 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.042896 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.044717 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.044696 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86eddfbd-6fe9-4278-8f66-9af507f0afa3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.044803 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.044774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86eddfbd-6fe9-4278-8f66-9af507f0afa3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.050469 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.050446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nkzg\" (UniqueName: \"kubernetes.io/projected/86eddfbd-6fe9-4278-8f66-9af507f0afa3-kube-api-access-4nkzg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc\" (UID: \"86eddfbd-6fe9-4278-8f66-9af507f0afa3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.137721 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.137686 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:50.260970 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.260923 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc"] May 21 11:56:50.264738 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:56:50.264711 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eddfbd_6fe9_4278_8f66_9af507f0afa3.slice/crio-fa6c50506b42bf61a42c108e7e8ac464658c7b748cceef386d7e2d967536da82 WatchSource:0}: Error finding container fa6c50506b42bf61a42c108e7e8ac464658c7b748cceef386d7e2d967536da82: Status 404 returned error can't find the container with id fa6c50506b42bf61a42c108e7e8ac464658c7b748cceef386d7e2d967536da82 May 21 11:56:50.273175 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:50.273150 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" event={"ID":"86eddfbd-6fe9-4278-8f66-9af507f0afa3","Type":"ContainerStarted","Data":"fa6c50506b42bf61a42c108e7e8ac464658c7b748cceef386d7e2d967536da82"} May 21 11:56:51.278103 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:51.278062 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" event={"ID":"86eddfbd-6fe9-4278-8f66-9af507f0afa3","Type":"ContainerStarted","Data":"a4044c1550f63e50dc72802de3ccbe2eb8a511477be617164920c0b584749bd1"} May 21 11:56:52.015879 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.015826 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr"] May 21 11:56:52.019130 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.019115 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.022092 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.022069 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 11:56:52.027993 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.027969 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr"] May 21 11:56:52.059495 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059452 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.059495 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.059701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.059701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkznk\" (UniqueName: \"kubernetes.io/projected/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kube-api-access-gkznk\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.059701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059645 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.059701 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.059681 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160604 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160549 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160604 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160593 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160842 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160636 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160842 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160652 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160842 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160669 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.160842 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.160697 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkznk\" (UniqueName: \"kubernetes.io/projected/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kube-api-access-gkznk\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.161089 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.161061 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.161149 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.161097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.161205 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.161155 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.162877 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.162825 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.163033 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.163017 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.169549 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.169529 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkznk\" (UniqueName: \"kubernetes.io/projected/a6d5de51-33c2-4aff-b2f5-3fe593db96ce-kube-api-access-gkznk\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr\" (UID: \"a6d5de51-33c2-4aff-b2f5-3fe593db96ce\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.330488 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.330388 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:52.465515 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:52.465489 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr"] May 21 11:56:52.467424 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:56:52.467395 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d5de51_33c2_4aff_b2f5_3fe593db96ce.slice/crio-a4cc042bdde411a054954c500aba2f140be7098810790c8d26e4940f3c355281 WatchSource:0}: Error finding container a4cc042bdde411a054954c500aba2f140be7098810790c8d26e4940f3c355281: Status 404 returned error can't find the container with id a4cc042bdde411a054954c500aba2f140be7098810790c8d26e4940f3c355281 May 21 11:56:53.287895 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:53.287843 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" event={"ID":"a6d5de51-33c2-4aff-b2f5-3fe593db96ce","Type":"ContainerStarted","Data":"d86b72f19c3f717e6869bf456bd2066b81cfd3caab20499e88e54aa104671897"} May 21 11:56:53.287895 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:53.287896 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" event={"ID":"a6d5de51-33c2-4aff-b2f5-3fe593db96ce","Type":"ContainerStarted","Data":"a4cc042bdde411a054954c500aba2f140be7098810790c8d26e4940f3c355281"} May 21 11:56:56.297951 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:56.297913 2557 generic.go:358] "Generic (PLEG): container finished" podID="86eddfbd-6fe9-4278-8f66-9af507f0afa3" containerID="a4044c1550f63e50dc72802de3ccbe2eb8a511477be617164920c0b584749bd1" exitCode=0 May 21 11:56:56.298389 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:56.297987 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" event={"ID":"86eddfbd-6fe9-4278-8f66-9af507f0afa3","Type":"ContainerDied","Data":"a4044c1550f63e50dc72802de3ccbe2eb8a511477be617164920c0b584749bd1"} May 21 11:56:57.309240 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:57.309206 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" event={"ID":"86eddfbd-6fe9-4278-8f66-9af507f0afa3","Type":"ContainerStarted","Data":"e0f99e6c6be1bede5a4892df505da0360a61d1a3b2090ac81e4aa256885a8175"} May 21 11:56:57.309607 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:57.309524 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:56:57.329088 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:57.329039 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" podStartSLOduration=8.108414775 podStartE2EDuration="8.329026297s" podCreationTimestamp="2026-05-21 11:56:49 +0000 UTC" firstStartedPulling="2026-05-21 11:56:56.298557023 +0000 UTC m=+851.063188972" lastFinishedPulling="2026-05-21 11:56:56.519168541 +0000 UTC m=+851.283800494" observedRunningTime="2026-05-21 11:56:57.328336147 +0000 UTC m=+852.092968122" watchObservedRunningTime="2026-05-21 11:56:57.329026297 +0000 UTC m=+852.093658308" May 21 11:56:58.313349 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:58.313316 2557 generic.go:358] "Generic (PLEG): container finished" podID="a6d5de51-33c2-4aff-b2f5-3fe593db96ce" containerID="d86b72f19c3f717e6869bf456bd2066b81cfd3caab20499e88e54aa104671897" exitCode=0 May 21 11:56:58.313735 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:58.313393 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" event={"ID":"a6d5de51-33c2-4aff-b2f5-3fe593db96ce","Type":"ContainerDied","Data":"d86b72f19c3f717e6869bf456bd2066b81cfd3caab20499e88e54aa104671897"} May 21 11:56:59.317900 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:59.317847 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" event={"ID":"a6d5de51-33c2-4aff-b2f5-3fe593db96ce","Type":"ContainerStarted","Data":"6ca3aa13e026937e8c1c97507b83af30a30aaf919785ebb1ba2bc30aae877aa1"} May 21 11:56:59.318296 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:59.318072 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:56:59.342068 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:56:59.342023 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" podStartSLOduration=7.980320528 podStartE2EDuration="8.342009209s" podCreationTimestamp="2026-05-21 11:56:51 +0000 UTC" firstStartedPulling="2026-05-21 11:56:58.314055694 +0000 UTC m=+853.078687643" lastFinishedPulling="2026-05-21 11:56:58.675744372 +0000 UTC m=+853.440376324" observedRunningTime="2026-05-21 11:56:59.340422179 +0000 UTC m=+854.105054161" watchObservedRunningTime="2026-05-21 11:56:59.342009209 +0000 UTC m=+854.106641183" May 21 11:57:08.325961 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:08.325931 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc" May 21 11:57:10.332670 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:10.332642 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr" May 21 11:57:11.705242 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.705204 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f54dcc47-2cmcc"] May 21 11:57:11.708074 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.708056 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.715417 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.715394 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f54dcc47-2cmcc"] May 21 11:57:11.830392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.830357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e8fea95-123f-421f-aec0-049852a7d4ec-tls-cert\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.830392 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.830398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4lwc\" (UniqueName: \"kubernetes.io/projected/8e8fea95-123f-421f-aec0-049852a7d4ec-kube-api-access-d4lwc\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.931095 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.931064 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e8fea95-123f-421f-aec0-049852a7d4ec-tls-cert\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.931095 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.931102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4lwc\" (UniqueName: \"kubernetes.io/projected/8e8fea95-123f-421f-aec0-049852a7d4ec-kube-api-access-d4lwc\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.933545 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.933515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e8fea95-123f-421f-aec0-049852a7d4ec-tls-cert\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:11.938769 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:11.938744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4lwc\" (UniqueName: \"kubernetes.io/projected/8e8fea95-123f-421f-aec0-049852a7d4ec-kube-api-access-d4lwc\") pod \"authorino-9f54dcc47-2cmcc\" (UID: \"8e8fea95-123f-421f-aec0-049852a7d4ec\") " pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:12.018022 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:12.017952 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f54dcc47-2cmcc" May 21 11:57:12.139069 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:12.138992 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f54dcc47-2cmcc"] May 21 11:57:12.141656 ip-10-0-128-31 kubenswrapper[2557]: W0521 11:57:12.141626 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e8fea95_123f_421f_aec0_049852a7d4ec.slice/crio-d9d443e954a451fce6227910e8520503df84e88781d47a5cf85262417c6c59ef WatchSource:0}: Error finding container d9d443e954a451fce6227910e8520503df84e88781d47a5cf85262417c6c59ef: Status 404 returned error can't find the container with id d9d443e954a451fce6227910e8520503df84e88781d47a5cf85262417c6c59ef May 21 11:57:12.362128 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:12.362095 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f54dcc47-2cmcc" event={"ID":"8e8fea95-123f-421f-aec0-049852a7d4ec","Type":"ContainerStarted","Data":"d9d443e954a451fce6227910e8520503df84e88781d47a5cf85262417c6c59ef"} May 21 11:57:13.366829 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.366790 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f54dcc47-2cmcc" event={"ID":"8e8fea95-123f-421f-aec0-049852a7d4ec","Type":"ContainerStarted","Data":"37a2ee29262fffbef0d33c8f8e6f6c8b97278a6334a2d47f7fbf0503141a9dbb"} May 21 11:57:13.383125 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.383061 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-9f54dcc47-2cmcc" podStartSLOduration=1.826713883 podStartE2EDuration="2.383040246s" podCreationTimestamp="2026-05-21 11:57:11 +0000 UTC" firstStartedPulling="2026-05-21 11:57:12.14336917 +0000 UTC m=+866.908001118" lastFinishedPulling="2026-05-21 11:57:12.699695532 +0000 UTC m=+867.464327481" observedRunningTime="2026-05-21 11:57:13.381961793 +0000 UTC m=+868.146593757" watchObservedRunningTime="2026-05-21 11:57:13.383040246 +0000 UTC m=+868.147672219" May 21 11:57:13.409061 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.409017 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:57:13.409312 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.409283 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-776c87846-4mchd" podUID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" containerName="authorino" containerID="cri-o://e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5" gracePeriod=30 May 21 11:57:13.642840 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.642817 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:57:13.745749 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.745715 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmvnm\" (UniqueName: \"kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm\") pod \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " May 21 11:57:13.745949 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.745763 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert\") pod \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\" (UID: \"d0db41b6-dbd0-436a-b832-ccec5d9b76b4\") " May 21 11:57:13.747829 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.747795 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm" (OuterVolumeSpecName: "kube-api-access-qmvnm") pod "d0db41b6-dbd0-436a-b832-ccec5d9b76b4" (UID: "d0db41b6-dbd0-436a-b832-ccec5d9b76b4"). InnerVolumeSpecName "kube-api-access-qmvnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:57:13.755260 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.755235 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d0db41b6-dbd0-436a-b832-ccec5d9b76b4" (UID: "d0db41b6-dbd0-436a-b832-ccec5d9b76b4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:57:13.846923 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.846898 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-tls-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:57:13.846923 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:13.846921 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmvnm\" (UniqueName: \"kubernetes.io/projected/d0db41b6-dbd0-436a-b832-ccec5d9b76b4-kube-api-access-qmvnm\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\"" May 21 11:57:14.370499 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.370463 2557 generic.go:358] "Generic (PLEG): container finished" podID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" containerID="e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5" exitCode=0 May 21 11:57:14.370911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.370507 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776c87846-4mchd" May 21 11:57:14.370911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.370546 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-776c87846-4mchd" event={"ID":"d0db41b6-dbd0-436a-b832-ccec5d9b76b4","Type":"ContainerDied","Data":"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5"} May 21 11:57:14.370911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.370578 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-776c87846-4mchd" event={"ID":"d0db41b6-dbd0-436a-b832-ccec5d9b76b4","Type":"ContainerDied","Data":"5159a90d51eb90cd2bfaea6feae09a08984b9455663aff0ce96c95084ca56d3b"} May 21 11:57:14.370911 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.370598 2557 scope.go:117] "RemoveContainer" containerID="e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5" May 21 11:57:14.378099 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.378083 2557 scope.go:117] "RemoveContainer" containerID="e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5" May 21 11:57:14.378395 ip-10-0-128-31 kubenswrapper[2557]: E0521 11:57:14.378374 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5\": container with ID starting with e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5 not found: ID does not exist" containerID="e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5" May 21 11:57:14.378443 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.378404 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5"} err="failed to get container status \"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5\": rpc error: code = NotFound desc = could not find container \"e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5\": container with ID starting with e765b4784e50b4c311c5cfa5bc52af0229e818fab80b8d020f43cc195277aad5 not found: ID does not exist" May 21 11:57:14.387714 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.387695 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:57:14.391796 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:14.391776 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-776c87846-4mchd"] May 21 11:57:15.872907 ip-10-0-128-31 kubenswrapper[2557]: I0521 11:57:15.872849 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" path="/var/lib/kubelet/pods/d0db41b6-dbd0-436a-b832-ccec5d9b76b4/volumes" May 21 12:01:42.505390 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:42.505342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f54dcc47-2cmcc_8e8fea95-123f-421f-aec0-049852a7d4ec/authorino/0.log" May 21 12:01:47.964319 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:47.964291 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f899c7c-jsgpt_aa0c4197-11ed-425f-9d32-d2871256d2ad/manager/0.log" May 21 12:01:49.510604 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:49.510571 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f54dcc47-2cmcc_8e8fea95-123f-421f-aec0-049852a7d4ec/authorino/0.log" May 21 12:01:49.867573 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:49.867548 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-67ckk_22fc59c6-9953-4efa-b6de-30900b1b58e2/kuadrant-console-plugin/0.log" May 21 12:01:50.936116 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:50.936088 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff9d596fb-ct9mz_9cd60be9-c576-4041-8ee0-ab4ccffb2544/kube-auth-proxy/0.log" May 21 12:01:51.749835 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:51.749797 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz_e3196fe2-daa8-44d9-8a06-020437887c11/storage-initializer/0.log" May 21 12:01:51.760337 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:51.760309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-gw9jz_e3196fe2-daa8-44d9-8a06-020437887c11/main/0.log" May 21 12:01:51.872459 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:51.872423 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc_86eddfbd-6fe9-4278-8f66-9af507f0afa3/storage-initializer/0.log" May 21 12:01:51.880116 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:51.880091 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-84ncc_86eddfbd-6fe9-4278-8f66-9af507f0afa3/main/0.log" May 21 12:01:52.257672 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:52.257645 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr_a6d5de51-33c2-4aff-b2f5-3fe593db96ce/storage-initializer/0.log" May 21 12:01:52.265518 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:52.265495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-knpxr_a6d5de51-33c2-4aff-b2f5-3fe593db96ce/main/0.log" May 21 12:01:56.995544 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:56.995504 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkblz/must-gather-4x8ht"] May 21 12:01:56.995944 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:56.995801 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" containerName="authorino" May 21 12:01:56.995944 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:56.995812 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" containerName="authorino" May 21 12:01:56.995944 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:56.995895 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0db41b6-dbd0-436a-b832-ccec5d9b76b4" containerName="authorino" May 21 12:01:56.998850 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:56.998834 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.001736 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.001717 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nkblz\"/\"default-dockercfg-xvgsm\"" May 21 12:01:57.002966 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.002949 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkblz\"/\"kube-root-ca.crt\"" May 21 12:01:57.003046 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.003027 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkblz\"/\"openshift-service-ca.crt\"" May 21 12:01:57.019841 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.019810 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/must-gather-4x8ht"] May 21 12:01:57.167137 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.167082 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-must-gather-output\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.167137 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.167136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxhw\" (UniqueName: \"kubernetes.io/projected/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-kube-api-access-jbxhw\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.268287 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.268198 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-must-gather-output\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.268287 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.268238 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxhw\" (UniqueName: \"kubernetes.io/projected/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-kube-api-access-jbxhw\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.268546 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.268521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-must-gather-output\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.278504 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.278470 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxhw\" (UniqueName: \"kubernetes.io/projected/6707b50b-e1ca-4b99-aa19-1f08869ccf5a-kube-api-access-jbxhw\") pod \"must-gather-4x8ht\" (UID: \"6707b50b-e1ca-4b99-aa19-1f08869ccf5a\") " pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.307547 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.307508 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/must-gather-4x8ht" May 21 12:01:57.434791 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.434683 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/must-gather-4x8ht"] May 21 12:01:57.437641 ip-10-0-128-31 kubenswrapper[2557]: W0521 12:01:57.437611 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6707b50b_e1ca_4b99_aa19_1f08869ccf5a.slice/crio-dcf4b168b9e6fe1163309b17fc9471f37f0ce2d72214fa6b0d6685a07b494691 WatchSource:0}: Error finding container dcf4b168b9e6fe1163309b17fc9471f37f0ce2d72214fa6b0d6685a07b494691: Status 404 returned error can't find the container with id dcf4b168b9e6fe1163309b17fc9471f37f0ce2d72214fa6b0d6685a07b494691 May 21 12:01:57.439343 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:57.439325 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 12:01:58.250373 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:58.250327 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/must-gather-4x8ht" event={"ID":"6707b50b-e1ca-4b99-aa19-1f08869ccf5a","Type":"ContainerStarted","Data":"dcf4b168b9e6fe1163309b17fc9471f37f0ce2d72214fa6b0d6685a07b494691"} May 21 12:01:59.257928 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:59.257894 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/must-gather-4x8ht" event={"ID":"6707b50b-e1ca-4b99-aa19-1f08869ccf5a","Type":"ContainerStarted","Data":"f21a744a92c7f6b03e8d0fe430591213806162ee4ebd8f12116cf0a39fe04438"} May 21 12:01:59.258397 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:59.257937 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/must-gather-4x8ht" event={"ID":"6707b50b-e1ca-4b99-aa19-1f08869ccf5a","Type":"ContainerStarted","Data":"9ba58c2cbf9ae92fd26addd853de5acd3b0c0b3815bb3514f3726be8294379b2"} May 21 12:01:59.276143 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:59.276092 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nkblz/must-gather-4x8ht" podStartSLOduration=2.447702795 podStartE2EDuration="3.276078375s" podCreationTimestamp="2026-05-21 12:01:56 +0000 UTC" firstStartedPulling="2026-05-21 12:01:57.439453088 +0000 UTC m=+1152.204085037" lastFinishedPulling="2026-05-21 12:01:58.267828665 +0000 UTC m=+1153.032460617" observedRunningTime="2026-05-21 12:01:59.274870435 +0000 UTC m=+1154.039502399" watchObservedRunningTime="2026-05-21 12:01:59.276078375 +0000 UTC m=+1154.040710346" May 21 12:01:59.880489 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:59.880455 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l8lxx_a38b9b06-5885-4368-929b-1f4fe73ae3ab/global-pull-secret-syncer/0.log" May 21 12:01:59.973841 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:01:59.973801 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5l2w9_ddbf58f2-ebb8-44b0-8015-cc1a139917e4/konnectivity-agent/0.log" May 21 12:02:00.064676 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:00.064651 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-31.ec2.internal_90aca22efb10402ecfb9f75795df2729/haproxy/0.log" May 21 12:02:04.545935 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:04.545611 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f54dcc47-2cmcc_8e8fea95-123f-421f-aec0-049852a7d4ec/authorino/0.log" May 21 12:02:04.696847 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:04.696811 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-67ckk_22fc59c6-9953-4efa-b6de-30900b1b58e2/kuadrant-console-plugin/0.log" May 21 12:02:07.029247 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:07.029221 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnmk_1fb38283-459e-4721-a5fb-96329cedccba/node-exporter/0.log" May 21 12:02:07.061285 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:07.061217 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnmk_1fb38283-459e-4721-a5fb-96329cedccba/kube-rbac-proxy/0.log" May 21 12:02:07.091743 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:07.091712 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnmk_1fb38283-459e-4721-a5fb-96329cedccba/init-textfile/0.log" May 21 12:02:08.074624 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.074591 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2"] May 21 12:02:08.079848 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.079819 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.088395 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.088368 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2"] May 21 12:02:08.170401 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.170369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-podres\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.170573 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.170412 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-proc\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.170573 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.170531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvv8q\" (UniqueName: \"kubernetes.io/projected/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-kube-api-access-vvv8q\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.170667 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.170581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-lib-modules\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.170728 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.170709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-sys\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271388 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271344 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvv8q\" (UniqueName: \"kubernetes.io/projected/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-kube-api-access-vvv8q\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271575 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271409 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-lib-modules\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271575 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271464 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-sys\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271575 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271513 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-podres\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271575 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271546 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-proc\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271784 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271628 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-proc\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271784 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-lib-modules\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271784 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-podres\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.271784 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.271753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-sys\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.286387 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.286354 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvv8q\" (UniqueName: \"kubernetes.io/projected/e61324d9-75f5-4115-a2b1-e6bcf9a06e63-kube-api-access-vvv8q\") pod \"perf-node-gather-daemonset-lf8l2\" (UID: \"e61324d9-75f5-4115-a2b1-e6bcf9a06e63\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.390911 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.390853 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:08.543131 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.541375 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2"] May 21 12:02:08.968217 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:08.968141 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-gwf79_d6e241b9-237c-47bc-93e3-096bbc8c6669/networking-console-plugin/0.log" May 21 12:02:09.301441 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:09.301342 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" event={"ID":"e61324d9-75f5-4115-a2b1-e6bcf9a06e63","Type":"ContainerStarted","Data":"7221eb1468dadcd033190e3565afa0c8896f67d7d6d7c89387f0a88959e4b58e"} May 21 12:02:09.301441 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:09.301391 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" event={"ID":"e61324d9-75f5-4115-a2b1-e6bcf9a06e63","Type":"ContainerStarted","Data":"f064280f7eec18cc6f2384a83548722d7f956c5abfad0053f906af3488633524"} May 21 12:02:09.302026 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:09.301488 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:09.320364 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:09.320298 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" podStartSLOduration=1.320278595 podStartE2EDuration="1.320278595s" podCreationTimestamp="2026-05-21 12:02:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:02:09.317594892 +0000 UTC m=+1164.082226864" watchObservedRunningTime="2026-05-21 12:02:09.320278595 +0000 UTC m=+1164.084910567" May 21 12:02:11.388402 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:11.388377 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rdf9_65ef81f8-5858-4a2d-af9a-e6fb8f141d9a/dns/0.log" May 21 12:02:11.422633 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:11.422606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rdf9_65ef81f8-5858-4a2d-af9a-e6fb8f141d9a/kube-rbac-proxy/0.log" May 21 12:02:11.597136 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:11.597109 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97xcr_e1983cb3-ecc9-439c-b96d-0939ac7ec812/dns-node-resolver/0.log" May 21 12:02:12.286217 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:12.286187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlkjf_cec6820b-7195-437d-8572-59ffea1ba1b7/node-ca/0.log" May 21 12:02:13.311461 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:13.311432 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff9d596fb-ct9mz_9cd60be9-c576-4041-8ee0-ab4ccffb2544/kube-auth-proxy/0.log" May 21 12:02:13.967214 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:13.967187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6hq25_7d10e4e6-6857-4ab9-81fd-9c31035a0de1/serve-healthcheck-canary/0.log" May 21 12:02:14.473147 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:14.473110 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgzjn_ab4d42ec-4d27-4a27-9329-e0053c6b8e64/kube-rbac-proxy/0.log" May 21 12:02:14.500820 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:14.500792 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgzjn_ab4d42ec-4d27-4a27-9329-e0053c6b8e64/exporter/0.log" May 21 12:02:14.532657 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:14.532631 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgzjn_ab4d42ec-4d27-4a27-9329-e0053c6b8e64/extractor/0.log" May 21 12:02:15.314951 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:15.314926 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-lf8l2" May 21 12:02:16.988835 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:16.988807 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f899c7c-jsgpt_aa0c4197-11ed-425f-9d32-d2871256d2ad/manager/0.log" May 21 12:02:18.413600 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:18.413574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6754f9fdfc-w7w2m_473b37c0-6b26-42be-a818-611b0df874cb/manager/0.log" May 21 12:02:24.129680 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.129646 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/kube-multus-additional-cni-plugins/0.log" May 21 12:02:24.155424 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.155400 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/egress-router-binary-copy/0.log" May 21 12:02:24.183747 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.183714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/cni-plugins/0.log" May 21 12:02:24.212232 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.212204 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/bond-cni-plugin/0.log" May 21 12:02:24.255743 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.255714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/routeoverride-cni/0.log" May 21 12:02:24.287391 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.287369 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/whereabouts-cni-bincopy/0.log" May 21 12:02:24.321682 ip-10-0-128-31 kubenswrapper[2557]: I0521 12:02:24.321655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fm9pn_e3b6b942-eb89-4c90-a056-f739da1a88c5/whereabouts-cni/0.log"