May 21 20:18:11.687006 ip-10-0-130-74 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 20:18:11.687018 ip-10-0-130-74 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 20:18:11.687025 ip-10-0-130-74 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 20:18:11.687287 ip-10-0-130-74 systemd[1]: Failed to start Kubernetes Kubelet. May 21 20:18:22.970867 ip-10-0-130-74 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 20:18:22.970884 ip-10-0-130-74 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8c6df3af173044308a9a08736535b95c -- May 21 20:20:43.653215 ip-10-0-130-74 systemd[1]: Starting Kubernetes Kubelet... May 21 20:20:44.133122 ip-10-0-130-74 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:44.133122 ip-10-0-130-74 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 20:20:44.133122 ip-10-0-130-74 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:44.133122 ip-10-0-130-74 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 20:20:44.133122 ip-10-0-130-74 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:44.136914 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.136780 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143670 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143698 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143709 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143713 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143716 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:44.143706 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143719 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143722 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143725 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143728 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143731 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143734 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143739 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143741 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143744 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143747 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143752 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143755 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143758 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143761 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143764 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143767 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143769 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143772 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143775 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143778 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:44.143985 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143781 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143783 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143789 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143791 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143794 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143797 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143800 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143803 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143806 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143808 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143811 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143813 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143816 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143818 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143822 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143827 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143831 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143833 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143836 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143859 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:44.144463 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143862 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143865 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143867 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143870 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143875 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143878 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143880 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143886 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143888 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143893 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143898 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143901 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143904 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143907 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143911 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143914 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143917 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143921 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143929 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:44.144977 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143932 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143935 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143938 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143941 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143943 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143946 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143949 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143952 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143954 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143957 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143960 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143963 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143968 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143976 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143980 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143982 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143985 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143988 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143990 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143993 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:44.145488 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143996 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.143999 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144725 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144731 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144737 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144740 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144743 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144746 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144748 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144751 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144754 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144757 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144759 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144762 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144765 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144768 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144773 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144776 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144779 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144782 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:44.146001 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144785 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144788 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144791 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144796 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144799 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144808 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144812 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144815 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144821 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144825 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144828 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144831 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144833 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144836 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144838 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144859 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144862 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144864 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144867 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:44.146485 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144870 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144875 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144878 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144880 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144883 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144886 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144888 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144891 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144894 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144896 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144899 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144902 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144906 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144909 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144914 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144916 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144919 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144922 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144926 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144935 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:44.147020 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144938 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144941 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144944 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144946 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144949 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144952 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144957 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144959 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144962 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144964 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144967 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144969 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144972 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144975 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144977 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144980 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144983 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144986 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144988 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:44.147537 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144995 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.144998 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145001 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145003 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145006 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145009 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145012 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145015 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145017 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.145020 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146104 2551 flags.go:64] FLAG: --address="0.0.0.0" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146124 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146131 2551 flags.go:64] FLAG: --anonymous-auth="true" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146140 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146145 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146148 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146154 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146158 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146161 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146164 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146168 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 20:20:44.148031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146171 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146175 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146178 2551 flags.go:64] FLAG: --cgroup-root="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146181 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146184 2551 flags.go:64] FLAG: --client-ca-file="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146186 2551 flags.go:64] FLAG: --cloud-config="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146189 2551 flags.go:64] FLAG: --cloud-provider="external" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146192 2551 flags.go:64] FLAG: --cluster-dns="[]" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146197 2551 flags.go:64] FLAG: --cluster-domain="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146200 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146203 2551 flags.go:64] FLAG: --config-dir="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146205 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146209 2551 flags.go:64] FLAG: --container-log-max-files="5" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146213 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146216 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146219 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146222 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146226 2551 flags.go:64] FLAG: --contention-profiling="false" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146229 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146232 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146235 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146238 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146244 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146247 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146250 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 20:20:44.148541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146253 2551 flags.go:64] FLAG: --enable-load-reader="false" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146256 2551 flags.go:64] FLAG: --enable-server="true" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146259 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146264 2551 flags.go:64] FLAG: --event-burst="100" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146267 2551 flags.go:64] FLAG: --event-qps="50" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146270 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146273 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146276 2551 flags.go:64] FLAG: --eviction-hard="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146280 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146283 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146286 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146289 2551 flags.go:64] FLAG: --eviction-soft="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146292 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146295 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146298 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146301 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146304 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146307 2551 flags.go:64] FLAG: --fail-swap-on="true" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146309 2551 flags.go:64] FLAG: --feature-gates="" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146314 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146317 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146320 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146323 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146326 2551 flags.go:64] FLAG: --healthz-port="10248" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146329 2551 flags.go:64] FLAG: --help="false" May 21 20:20:44.149160 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146332 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-130-74.ec2.internal" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146335 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146337 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146340 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146347 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146352 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146354 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146357 2551 flags.go:64] FLAG: --image-service-endpoint="" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146360 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146371 2551 flags.go:64] FLAG: --kube-api-burst="100" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146374 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146378 2551 flags.go:64] FLAG: --kube-api-qps="50" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146381 2551 flags.go:64] FLAG: --kube-reserved="" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146384 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146386 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146389 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146392 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146395 2551 flags.go:64] FLAG: --lock-file="" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146398 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146401 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146404 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146409 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146412 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146415 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 21 20:20:44.149759 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146418 2551 flags.go:64] FLAG: --logging-format="text" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146421 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146424 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146426 2551 flags.go:64] FLAG: --manifest-url="" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146430 2551 flags.go:64] FLAG: --manifest-url-header="" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146434 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146438 2551 flags.go:64] FLAG: --max-open-files="1000000" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146442 2551 flags.go:64] FLAG: --max-pods="110" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146445 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146448 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146450 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146453 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146458 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146461 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146463 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146473 2551 flags.go:64] FLAG: --node-status-max-images="50" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146476 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146479 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146488 2551 flags.go:64] FLAG: --pod-cidr="" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146491 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146497 2551 flags.go:64] FLAG: --pod-manifest-path="" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146500 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146503 2551 flags.go:64] FLAG: --pods-per-core="0" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146506 2551 flags.go:64] FLAG: --port="10250" May 21 20:20:44.150348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146509 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146512 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e75b65a6db5bb8e8" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146516 2551 flags.go:64] FLAG: --qos-reserved="" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146518 2551 flags.go:64] FLAG: --read-only-port="10255" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146522 2551 flags.go:64] FLAG: --register-node="true" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146525 2551 flags.go:64] FLAG: --register-schedulable="true" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146528 2551 flags.go:64] FLAG: --register-with-taints="" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146536 2551 flags.go:64] FLAG: --registry-burst="10" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146539 2551 flags.go:64] FLAG: --registry-qps="5" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146542 2551 flags.go:64] FLAG: --reserved-cpus="" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146545 2551 flags.go:64] FLAG: --reserved-memory="" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146548 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146551 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146554 2551 flags.go:64] FLAG: --rotate-certificates="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146557 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146560 2551 flags.go:64] FLAG: --runonce="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146563 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146566 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146569 2551 flags.go:64] FLAG: --seccomp-default="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146590 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146596 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146600 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146603 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146606 2551 flags.go:64] FLAG: --storage-driver-password="root" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146609 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146612 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 21 20:20:44.150949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146615 2551 flags.go:64] FLAG: --storage-driver-user="root" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146624 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146627 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146630 2551 flags.go:64] FLAG: --system-cgroups="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146632 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146639 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146642 2551 flags.go:64] FLAG: --tls-cert-file="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146644 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146652 2551 flags.go:64] FLAG: --tls-min-version="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146655 2551 flags.go:64] FLAG: --tls-private-key-file="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146658 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146660 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146663 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146666 2551 flags.go:64] FLAG: --v="2" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146671 2551 flags.go:64] FLAG: --version="false" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146675 2551 flags.go:64] FLAG: --vmodule="" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146680 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.146683 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146797 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146801 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146804 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146808 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146810 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:44.151602 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146813 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146816 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146818 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146823 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146827 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146830 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146833 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146835 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146838 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146858 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146862 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146881 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146885 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146888 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146891 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146893 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146896 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146898 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146901 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146904 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:44.152205 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146907 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146909 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146912 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146914 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146917 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146919 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146922 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146924 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146926 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146929 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146931 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146934 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146936 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146938 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146941 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146945 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146949 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146952 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146954 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146957 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:44.152721 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146960 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146964 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146968 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146970 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146980 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146983 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146986 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146989 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146991 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146994 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146997 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.146999 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147002 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147005 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147008 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147010 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147013 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147015 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147018 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147021 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:44.153447 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147024 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147027 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147029 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147032 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147035 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147038 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147040 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147044 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147048 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147050 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147053 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147056 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147060 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147063 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147065 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147068 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147070 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147079 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147082 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:44.154335 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147084 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:44.155170 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.147087 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:44.155170 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.147093 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:44.155930 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.155900 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 20:20:44.156000 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.155934 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 20:20:44.156045 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156020 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:44.156045 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156029 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:44.156045 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156035 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:44.156045 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156040 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:44.156045 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156045 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156049 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156054 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156059 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156065 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156070 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156074 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156079 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156083 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156087 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156092 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156096 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156100 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156105 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156109 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156113 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156118 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156122 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156126 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156130 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:44.156274 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156134 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156139 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156143 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156147 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156154 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156161 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156166 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156174 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156178 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156183 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156187 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156190 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156195 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156199 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156204 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156209 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156213 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156218 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156222 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:44.157155 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156226 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156231 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156234 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156239 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156243 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156247 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156252 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156256 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156260 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156264 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156268 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156272 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156276 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156280 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156284 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156291 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156295 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156299 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156303 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156310 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:44.157668 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156317 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156323 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156327 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156331 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156335 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156339 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156343 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156349 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156353 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156357 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156361 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156366 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156370 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156374 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156378 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156382 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156386 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156391 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156395 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:44.158273 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156399 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156403 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156408 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156412 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.156421 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156587 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156595 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156600 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156605 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156609 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156613 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156617 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156622 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156626 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156632 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156637 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:44.158753 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156641 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156645 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156650 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156654 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156659 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156663 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156667 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156672 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156676 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156680 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156684 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156689 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156693 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156696 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156701 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156705 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156710 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156714 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156718 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:44.159432 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156722 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156726 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156730 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156734 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156738 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156743 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156747 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156752 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156756 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156764 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156770 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156775 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156780 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156796 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156800 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156805 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156809 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156813 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156817 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:44.160478 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156821 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156826 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156831 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156835 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156839 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156868 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156872 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156876 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156881 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156885 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156889 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156893 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156897 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156901 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156906 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156910 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156914 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156918 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156922 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156926 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:44.161006 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156932 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156937 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156942 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156946 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156951 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156955 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156959 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156965 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156970 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156974 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156978 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156983 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156987 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156991 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156995 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.156999 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:44.161632 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:44.157004 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:44.162068 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.157012 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:44.162068 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.157959 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 21 20:20:44.162068 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.161115 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 20:20:44.162269 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.162252 2551 server.go:1019] "Starting client certificate rotation" May 21 20:20:44.162390 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.162371 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:20:44.162423 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.162411 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:20:44.192280 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.192240 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:20:44.195138 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.195099 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:20:44.212894 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.212869 2551 log.go:25] "Validated CRI v1 runtime API" May 21 20:20:44.219433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.219399 2551 log.go:25] "Validated CRI v1 image API" May 21 20:20:44.220807 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.220785 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 20:20:44.223649 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.223626 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:20:44.225793 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.225765 2551 fs.go:135] Filesystem UUIDs: map[1feecf33-980c-4ced-84f2-9f3169cbe65c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 90727d15-c61c-494a-a78b-d94830aff14a:/dev/nvme0n1p3] May 21 20:20:44.225919 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.225791 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 20:20:44.230350 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.230227 2551 manager.go:217] Machine: {Timestamp:2026-05-21 20:20:44.229623216 +0000 UTC m=+0.457570640 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093337 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f09e16ce977f362d76a5eb0563140 SystemUUID:ec2f09e1-6ce9-77f3-62d7-6a5eb0563140 BootID:8c6df3af-1730-4430-8a9a-08736535b95c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:e5:6a:cd:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:e5:6a:cd:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:7a:f1:e7:22:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 20:20:44.231675 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.231663 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 20:20:44.231784 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.231769 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 20:20:44.233722 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.233689 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 20:20:44.233896 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.233725 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 20:20:44.233947 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.233905 2551 topology_manager.go:138] "Creating topology manager with none policy" May 21 20:20:44.233947 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.233913 2551 container_manager_linux.go:306] "Creating device plugin manager" May 21 20:20:44.233947 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.233921 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:20:44.236508 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.236492 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:20:44.238853 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.238826 2551 state_mem.go:36] "Initialized new in-memory state store" May 21 20:20:44.238990 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.238981 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 20:20:44.242040 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.242026 2551 kubelet.go:491] "Attempting to sync node with API server" May 21 20:20:44.242082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.242045 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 20:20:44.242082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.242059 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 20:20:44.242082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.242069 2551 kubelet.go:397] "Adding apiserver pod source" May 21 20:20:44.242082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.242079 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 20:20:44.243239 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.243224 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:20:44.243282 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.243246 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:20:44.246540 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.246519 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 20:20:44.248809 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.248794 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 20:20:44.250869 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250836 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 20:20:44.250869 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250872 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250878 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250884 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250892 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250899 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250904 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250912 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250920 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250925 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250939 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 20:20:44.250960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.250945 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 20:20:44.251785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.251775 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 20:20:44.251785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.251785 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 20:20:44.255082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255064 2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 20:20:44.255133 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.255078 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 20:20:44.255133 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.255080 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 20:20:44.255264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255252 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 20:20:44.255305 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255291 2551 server.go:1295] "Started kubelet" May 21 20:20:44.255387 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255346 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 20:20:44.255453 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255404 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 20:20:44.255506 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.255473 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 20:20:44.256112 ip-10-0-130-74 systemd[1]: Started Kubernetes Kubelet. May 21 20:20:44.256922 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.256880 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 20:20:44.257455 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.257443 2551 server.go:317] "Adding debug handlers to kubelet server" May 21 20:20:44.264554 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.264512 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 20:20:44.264757 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.264735 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 20:20:44.265153 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.265138 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 20:20:44.265357 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.265339 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 20:20:44.265357 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.265359 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 20:20:44.267975 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.267904 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 20:20:44.268161 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.268144 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.268399 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.268378 2551 reconstruct.go:97] "Volume reconstruction finished" May 21 20:20:44.268484 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.268400 2551 reconciler.go:26] "Reconciler: start to sync state" May 21 20:20:44.268669 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.268643 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrgbw" May 21 20:20:44.269111 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269086 2551 factory.go:55] Registering systemd factory May 21 20:20:44.269204 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269142 2551 factory.go:223] Registration of the systemd container factory successfully May 21 20:20:44.269519 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269505 2551 factory.go:153] Registering CRI-O factory May 21 20:20:44.269519 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269521 2551 factory.go:223] Registration of the crio container factory successfully May 21 20:20:44.269637 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269584 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 20:20:44.269637 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269603 2551 factory.go:103] Registering Raw factory May 21 20:20:44.269637 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.269622 2551 manager.go:1196] Started watching for new ooms in manager May 21 20:20:44.270118 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.270103 2551 manager.go:319] Starting recovery of all containers May 21 20:20:44.272003 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.271969 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 20:20:44.272150 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.272131 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 20:20:44.275016 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.271554 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-74.ec2.internal.18b1ae2ee6ff239a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-74.ec2.internal,UID:ip-10-0-130-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-74.ec2.internal,},FirstTimestamp:2026-05-21 20:20:44.25526569 +0000 UTC m=+0.483213112,LastTimestamp:2026-05-21 20:20:44.25526569 +0000 UTC m=+0.483213112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-74.ec2.internal,}" May 21 20:20:44.276103 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.276075 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrgbw" May 21 20:20:44.282925 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.282899 2551 manager.go:324] Recovery completed May 21 20:20:44.287273 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.287256 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.289731 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.289714 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.289861 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.289743 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.289861 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.289754 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.290322 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.290298 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 20:20:44.290322 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.290313 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 20:20:44.290402 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.290331 2551 state_mem.go:36] "Initialized new in-memory state store" May 21 20:20:44.291602 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.291527 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-74.ec2.internal.18b1ae2ee90d08fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-74.ec2.internal,UID:ip-10-0-130-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-74.ec2.internal,},FirstTimestamp:2026-05-21 20:20:44.289730814 +0000 UTC m=+0.517678236,LastTimestamp:2026-05-21 20:20:44.289730814 +0000 UTC m=+0.517678236,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-74.ec2.internal,}" May 21 20:20:44.294092 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.294078 2551 policy_none.go:49] "None policy: Start" May 21 20:20:44.294162 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.294097 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 20:20:44.294162 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.294109 2551 state_mem.go:35] "Initializing new in-memory state store" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.341621 2551 manager.go:341] "Starting Device Plugin manager" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.341658 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.341668 2551 server.go:85] "Starting device plugin registration server" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.341939 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.341949 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.342047 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.342116 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.342122 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.342760 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 20:20:44.357342 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.342803 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.370290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.370257 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 20:20:44.371657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.371632 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 20:20:44.371657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.371658 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 20:20:44.371806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.371683 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 20:20:44.371806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.371690 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 21 20:20:44.371806 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.371733 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 20:20:44.377304 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.377278 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:44.442369 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.442278 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.443935 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.443920 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.444036 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.443950 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.444036 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.443959 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.444036 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.443984 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-74.ec2.internal" May 21 20:20:44.452168 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.452136 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-74.ec2.internal" May 21 20:20:44.452168 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.452175 2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-74.ec2.internal\": node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.468329 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.468299 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.472964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.472937 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal"] May 21 20:20:44.473041 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.473016 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.474011 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.473993 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.474112 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.474024 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.474112 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.474039 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.476371 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.476356 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.476552 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.476538 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.476594 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.476568 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.477713 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477698 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.477800 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477719 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.477800 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477740 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.477800 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477749 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.477800 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477726 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.478005 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.477823 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.479931 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.479915 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:44.480015 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.479941 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:44.480746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.480731 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:44.480833 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.480754 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:44.480833 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.480767 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:44.501775 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.501748 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-74.ec2.internal\" not found" node="ip-10-0-130-74.ec2.internal" May 21 20:20:44.506399 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.506377 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-74.ec2.internal\" not found" node="ip-10-0-130-74.ec2.internal" May 21 20:20:44.569148 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.569104 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.570304 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.570281 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.570363 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.570315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.570363 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.570337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218dda9ded7f9e55e144b6f5a2217224-config\") pod \"kube-apiserver-proxy-ip-10-0-130-74.ec2.internal\" (UID: \"218dda9ded7f9e55e144b6f5a2217224\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:44.669692 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.669643 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.670827 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670801 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.670936 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670868 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.670936 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670903 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218dda9ded7f9e55e144b6f5a2217224-config\") pod \"kube-apiserver-proxy-ip-10-0-130-74.ec2.internal\" (UID: \"218dda9ded7f9e55e144b6f5a2217224\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:44.670936 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670919 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.671050 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218dda9ded7f9e55e144b6f5a2217224-config\") pod \"kube-apiserver-proxy-ip-10-0-130-74.ec2.internal\" (UID: \"218dda9ded7f9e55e144b6f5a2217224\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:44.671050 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.670987 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1178cee131de9f92e03e50170cefe7e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal\" (UID: \"1178cee131de9f92e03e50170cefe7e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.770624 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.770560 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.804808 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.804784 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:44.809215 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:44.809191 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:44.871173 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.871118 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:44.971790 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:44.971748 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.072453 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.072383 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.161743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.161690 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 20:20:45.162369 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.161899 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:20:45.173108 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.173088 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.265562 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.265529 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 20:20:45.274585 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.274545 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.278300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.278266 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 20:15:44 +0000 UTC" deadline="2027-10-26 22:16:11.567981741 +0000 UTC" May 21 20:20:45.278300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.278299 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12553h55m26.289686018s" May 21 20:20:45.289080 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.289044 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:20:45.319342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.319311 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7clld" May 21 20:20:45.328796 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.328734 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7clld" May 21 20:20:45.354322 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:45.354272 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218dda9ded7f9e55e144b6f5a2217224.slice/crio-93d5b942275161871bfbb6a8045fbc93b56d1365f583a84eba60cfc4273203b4 WatchSource:0}: Error finding container 93d5b942275161871bfbb6a8045fbc93b56d1365f583a84eba60cfc4273203b4: Status 404 returned error can't find the container with id 93d5b942275161871bfbb6a8045fbc93b56d1365f583a84eba60cfc4273203b4 May 21 20:20:45.354576 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:45.354549 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1178cee131de9f92e03e50170cefe7e8.slice/crio-33518b03f17612f9d41a679e24443d7ca269729a47012989adc688a3bd87cd2b WatchSource:0}: Error finding container 33518b03f17612f9d41a679e24443d7ca269729a47012989adc688a3bd87cd2b: Status 404 returned error can't find the container with id 33518b03f17612f9d41a679e24443d7ca269729a47012989adc688a3bd87cd2b May 21 20:20:45.357980 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.357955 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:20:45.374630 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.374606 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.375830 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.375787 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" event={"ID":"1178cee131de9f92e03e50170cefe7e8","Type":"ContainerStarted","Data":"33518b03f17612f9d41a679e24443d7ca269729a47012989adc688a3bd87cd2b"} May 21 20:20:45.376785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.376767 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" event={"ID":"218dda9ded7f9e55e144b6f5a2217224","Type":"ContainerStarted","Data":"93d5b942275161871bfbb6a8045fbc93b56d1365f583a84eba60cfc4273203b4"} May 21 20:20:45.475421 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.475376 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.575993 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.575966 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.670695 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.670663 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:45.676543 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:45.676497 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-74.ec2.internal\" not found" May 21 20:20:45.728463 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.728430 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:45.765440 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.765405 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" May 21 20:20:45.782457 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.782427 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:20:45.784302 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.784274 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" May 21 20:20:45.794685 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.794660 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:20:45.847243 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:45.847211 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:46.242609 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.242562 2551 apiserver.go:52] "Watching apiserver" May 21 20:20:46.250039 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.249823 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 20:20:46.250223 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.250198 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-lrxbs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal","openshift-network-operator/iptables-alerter-hmk8j","openshift-cluster-node-tuning-operator/tuned-57vbn","openshift-multus/multus-4dqtt","openshift-multus/multus-additional-cni-plugins-zbh5s","openshift-multus/network-metrics-daemon-c6rq8","openshift-network-diagnostics/network-check-target-zgrgl","openshift-ovn-kubernetes/ovnkube-node-tcncm","kube-system/konnectivity-agent-6xrrl","kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4"] May 21 20:20:46.255274 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.255250 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.255400 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.255337 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.257490 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.257468 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.258178 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258160 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbxdg\"" May 21 20:20:46.258178 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258170 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 20:20:46.258344 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258323 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 20:20:46.258590 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258541 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 20:20:46.258697 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258659 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 20:20:46.258697 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258671 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 20:20:46.258815 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258762 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 20:20:46.258925 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.258909 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-45ght\"" May 21 20:20:46.262805 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.262191 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n7k96\"" May 21 20:20:46.262805 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.262499 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.262805 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.262704 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 20:20:46.263034 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.262825 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 20:20:46.263149 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.263123 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dqtt" May 21 20:20:46.265459 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.265436 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7s88\"" May 21 20:20:46.265684 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.265666 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 20:20:46.265734 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.265726 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.265830 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.265801 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:46.266736 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.266071 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 20:20:46.268229 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.268188 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vw85f\"" May 21 20:20:46.268391 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.268376 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 20:20:46.268682 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.268664 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 20:20:46.268898 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.268883 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 20:20:46.269145 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.269124 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 20:20:46.270558 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.270534 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:46.270651 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.270626 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:46.270765 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.270746 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.272891 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.272872 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 20:20:46.272967 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.272872 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nbnsx\"" May 21 20:20:46.273262 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273238 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 20:20:46.273349 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273292 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 20:20:46.273405 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273387 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 20:20:46.273642 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273625 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 20:20:46.273711 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273680 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 20:20:46.273959 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.273939 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.275967 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.275951 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 20:20:46.276058 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.276010 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 20:20:46.276251 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.276234 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t7b47\"" May 21 20:20:46.276417 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.276401 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.278550 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.278530 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 20:20:46.278885 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.278869 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 20:20:46.279097 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.279083 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 20:20:46.279287 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.279272 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x79pt\"" May 21 20:20:46.280482 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280456 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-var-lib-kubelet\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.280567 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280494 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-host\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.280567 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280511 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b04e2e4-9a63-46ba-99d3-abb3af641249-host\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.280567 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280525 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-daemon-config\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.280567 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280542 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-conf\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.280567 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280556 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280571 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-kubelet\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5nl6\" (UniqueName: \"kubernetes.io/projected/71ba3135-325d-465a-ae56-7bb40941ebb2-kube-api-access-k5nl6\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280603 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280624 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-node-log\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280638 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-log-socket\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280654 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-script-lib\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280684 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280706 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-bin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280735 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6df3c901-7e72-45e4-b14a-5ef84c6f060d-host-slash\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.280761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280752 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-slash\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280783 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-conf-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280804 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-systemd\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280819 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589xp\" (UniqueName: \"kubernetes.io/projected/dc0646be-be5c-4d1a-8b47-a05776491aea-kube-api-access-589xp\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280873 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6df3c901-7e72-45e4-b14a-5ef84c6f060d-iptables-alerter-script\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280911 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-etc-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280952 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-system-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280971 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n27k\" (UniqueName: \"kubernetes.io/projected/6df3c901-7e72-45e4-b14a-5ef84c6f060d-kube-api-access-9n27k\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.280985 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysconfig\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281000 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-sys\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281014 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-os-release\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281028 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswkn\" (UniqueName: \"kubernetes.io/projected/080f4e4a-bf3c-4024-975a-8d3fe14d3146-kube-api-access-qswkn\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-modprobe-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281056 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8b7\" (UniqueName: \"kubernetes.io/projected/13f71580-60d7-4a17-ac67-edb1ba57e4f1-kube-api-access-hx8b7\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281087 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-config\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281104 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b04e2e4-9a63-46ba-99d3-abb3af641249-serviceca\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281119 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-netns\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281133 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-ovn\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281147 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-lib-modules\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281160 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-tuned\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281173 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-systemd-units\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281186 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-netns\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281200 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cnibin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-k8s-cni-cncf-io\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281254 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-cnibin\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281268 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281288 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-bin\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-netd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281320 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-os-release\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.281643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281334 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-multus\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281350 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cni-binary-copy\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281370 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-kubelet\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281387 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281401 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-systemd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281431 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a171f00-4152-4a3b-852d-308a9783ec5e-ovn-node-metrics-cert\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281446 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-socket-dir-parent\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281467 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-hostroot\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-tmp\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-system-cni-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281517 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-var-lib-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281535 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281560 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-env-overrides\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qssm2\" (UniqueName: \"kubernetes.io/projected/2a171f00-4152-4a3b-852d-308a9783ec5e-kube-api-access-qssm2\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281614 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjkn\" (UniqueName: \"kubernetes.io/projected/9b04e2e4-9a63-46ba-99d3-abb3af641249-kube-api-access-mfjkn\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281639 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-etc-kubernetes\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.282412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-multus-certs\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.283231 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281688 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-kubernetes\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.283231 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.281712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-run\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.330021 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.329984 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:15:45 +0000 UTC" deadline="2028-02-22 00:17:19.172584292 +0000 UTC" May 21 20:20:46.330021 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.330020 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15387h56m32.84256877s" May 21 20:20:46.368972 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.368941 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 20:20:46.382212 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382174 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-etc-kubernetes\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.382212 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382212 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-multus-certs\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382237 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-kubernetes\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382261 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-run\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382280 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-var-lib-kubelet\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382299 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-host\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b04e2e4-9a63-46ba-99d3-abb3af641249-host\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382341 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-daemon-config\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382364 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-conf\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382376 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-kubernetes\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382387 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382375 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-run\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382410 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-kubelet\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382411 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b04e2e4-9a63-46ba-99d3-abb3af641249-host\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382438 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-device-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382457 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-var-lib-kubelet\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382462 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-etc-selinux\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382316 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-etc-kubernetes\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.382510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382505 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5nl6\" (UniqueName: \"kubernetes.io/projected/71ba3135-325d-465a-ae56-7bb40941ebb2-kube-api-access-k5nl6\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382537 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382556 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-host\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382565 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-node-log\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382608 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-log-socket\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382638 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382643 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-kubelet\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382667 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-script-lib\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382681 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382692 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382749 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-bin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382770 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6df3c901-7e72-45e4-b14a-5ef84c6f060d-host-slash\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382810 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-slash\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382866 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-conf-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382894 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/598641f6-a843-45ee-bbb8-3a13d707e78e-konnectivity-ca\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382951 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-node-log\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383004 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-daemon-config\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.383327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.382812 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-conf\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383067 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-log-socket\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383089 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-bin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383160 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-conf-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383170 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6df3c901-7e72-45e4-b14a-5ef84c6f060d-host-slash\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383201 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-systemd\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383240 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-slash\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383271 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-589xp\" (UniqueName: \"kubernetes.io/projected/dc0646be-be5c-4d1a-8b47-a05776491aea-kube-api-access-589xp\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383291 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-systemd\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383335 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383384 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6df3c901-7e72-45e4-b14a-5ef84c6f060d-iptables-alerter-script\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383442 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383489 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.383493 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383505 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-script-lib\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383554 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-multus-certs\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383570 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383597 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-etc-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383623 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-etc-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.383635 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:46.883599086 +0000 UTC m=+3.111546515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383709 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-system-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-socket-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383766 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n27k\" (UniqueName: \"kubernetes.io/projected/6df3c901-7e72-45e4-b14a-5ef84c6f060d-kube-api-access-9n27k\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383773 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-system-cni-dir\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383800 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysconfig\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383824 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-sys\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383869 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-os-release\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383898 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswkn\" (UniqueName: \"kubernetes.io/projected/080f4e4a-bf3c-4024-975a-8d3fe14d3146-kube-api-access-qswkn\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383903 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6df3c901-7e72-45e4-b14a-5ef84c6f060d-iptables-alerter-script\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383905 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-sys\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383927 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-os-release\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383875 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysconfig\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383922 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-modprobe-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.384836 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383966 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8b7\" (UniqueName: \"kubernetes.io/projected/13f71580-60d7-4a17-ac67-edb1ba57e4f1-kube-api-access-hx8b7\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383983 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.383990 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-config\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384014 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b04e2e4-9a63-46ba-99d3-abb3af641249-serviceca\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384037 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-netns\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384067 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79nmv\" (UniqueName: \"kubernetes.io/projected/77aa02e7-f074-430f-bb6c-d35c496b1988-kube-api-access-79nmv\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384083 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-modprobe-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384095 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/598641f6-a843-45ee-bbb8-3a13d707e78e-agent-certs\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384120 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-netns\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384121 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-ovn\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384167 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-lib-modules\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384183 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-tuned\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384199 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-ovn\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384199 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-systemd-units\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384230 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-systemd-units\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384236 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-netns\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384258 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-netns\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384260 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cnibin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.385586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384284 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-k8s-cni-cncf-io\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cnibin\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384306 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384331 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-cnibin\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384326 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-lib-modules\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384360 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384387 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-bin\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384392 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-cnibin\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384412 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-netd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384434 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-sysctl-d\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384446 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b04e2e4-9a63-46ba-99d3-abb3af641249-serviceca\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384457 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-ovnkube-config\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384451 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-netd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384478 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-cni-bin\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384462 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-run-k8s-cni-cncf-io\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384517 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384542 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-os-release\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384564 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-multus\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.386730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384596 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cni-binary-copy\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384612 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-os-release\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384621 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-kubelet\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384613 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384656 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-cni-multus\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384648 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-sys-fs\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384703 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384715 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-host-var-lib-kubelet\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384735 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-systemd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384762 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384786 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a171f00-4152-4a3b-852d-308a9783ec5e-ovn-node-metrics-cert\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384786 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-run-systemd\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384811 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-socket-dir-parent\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-multus-socket-dir-parent\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.384977 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-hostroot\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-registration-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385068 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-tmp\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.387527 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385094 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-system-cni-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385104 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/080f4e4a-bf3c-4024-975a-8d3fe14d3146-cni-binary-copy\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385120 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-var-lib-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385162 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-var-lib-openvswitch\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385163 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385194 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-env-overrides\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385220 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qssm2\" (UniqueName: \"kubernetes.io/projected/2a171f00-4152-4a3b-852d-308a9783ec5e-kube-api-access-qssm2\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385247 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjkn\" (UniqueName: \"kubernetes.io/projected/9b04e2e4-9a63-46ba-99d3-abb3af641249-kube-api-access-mfjkn\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385242 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/080f4e4a-bf3c-4024-975a-8d3fe14d3146-hostroot\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385315 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a171f00-4152-4a3b-852d-308a9783ec5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385354 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc0646be-be5c-4d1a-8b47-a05776491aea-system-cni-dir\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385665 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a171f00-4152-4a3b-852d-308a9783ec5e-env-overrides\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.388226 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.385954 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc0646be-be5c-4d1a-8b47-a05776491aea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.388776 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.388390 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-tmp\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.389216 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.389190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13f71580-60d7-4a17-ac67-edb1ba57e4f1-etc-tuned\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.391064 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.391043 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a171f00-4152-4a3b-852d-308a9783ec5e-ovn-node-metrics-cert\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.395860 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.395821 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:46.395958 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.395868 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:46.395958 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.395884 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:46.396066 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.395967 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:46.895941966 +0000 UTC m=+3.123889387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:46.398091 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.397960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswkn\" (UniqueName: \"kubernetes.io/projected/080f4e4a-bf3c-4024-975a-8d3fe14d3146-kube-api-access-qswkn\") pod \"multus-4dqtt\" (UID: \"080f4e4a-bf3c-4024-975a-8d3fe14d3146\") " pod="openshift-multus/multus-4dqtt" May 21 20:20:46.398302 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.398269 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssm2\" (UniqueName: \"kubernetes.io/projected/2a171f00-4152-4a3b-852d-308a9783ec5e-kube-api-access-qssm2\") pod \"ovnkube-node-tcncm\" (UID: \"2a171f00-4152-4a3b-852d-308a9783ec5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.399070 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.399050 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5nl6\" (UniqueName: \"kubernetes.io/projected/71ba3135-325d-465a-ae56-7bb40941ebb2-kube-api-access-k5nl6\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.399174 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.399158 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n27k\" (UniqueName: \"kubernetes.io/projected/6df3c901-7e72-45e4-b14a-5ef84c6f060d-kube-api-access-9n27k\") pod \"iptables-alerter-hmk8j\" (UID: \"6df3c901-7e72-45e4-b14a-5ef84c6f060d\") " pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.399233 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.399190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8b7\" (UniqueName: \"kubernetes.io/projected/13f71580-60d7-4a17-ac67-edb1ba57e4f1-kube-api-access-hx8b7\") pod \"tuned-57vbn\" (UID: \"13f71580-60d7-4a17-ac67-edb1ba57e4f1\") " pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.399571 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.399550 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-589xp\" (UniqueName: \"kubernetes.io/projected/dc0646be-be5c-4d1a-8b47-a05776491aea-kube-api-access-589xp\") pod \"multus-additional-cni-plugins-zbh5s\" (UID: \"dc0646be-be5c-4d1a-8b47-a05776491aea\") " pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.402835 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.402815 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjkn\" (UniqueName: \"kubernetes.io/projected/9b04e2e4-9a63-46ba-99d3-abb3af641249-kube-api-access-mfjkn\") pod \"node-ca-lrxbs\" (UID: \"9b04e2e4-9a63-46ba-99d3-abb3af641249\") " pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.407032 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.407012 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:46.486237 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79nmv\" (UniqueName: \"kubernetes.io/projected/77aa02e7-f074-430f-bb6c-d35c496b1988-kube-api-access-79nmv\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486237 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486242 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/598641f6-a843-45ee-bbb8-3a13d707e78e-agent-certs\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.486463 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486377 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-sys-fs\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486463 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486410 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486463 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486433 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-registration-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486472 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-device-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486486 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-sys-fs\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486496 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-etc-selinux\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486541 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486547 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/598641f6-a843-45ee-bbb8-3a13d707e78e-konnectivity-ca\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.486593 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486582 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-device-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486812 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486602 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-socket-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486812 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486582 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-registration-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486812 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486619 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-etc-selinux\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.486812 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486736 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77aa02e7-f074-430f-bb6c-d35c496b1988-socket-dir\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.487000 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.486964 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/598641f6-a843-45ee-bbb8-3a13d707e78e-konnectivity-ca\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.488706 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.488688 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/598641f6-a843-45ee-bbb8-3a13d707e78e-agent-certs\") pod \"konnectivity-agent-6xrrl\" (UID: \"598641f6-a843-45ee-bbb8-3a13d707e78e\") " pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.493972 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.493910 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79nmv\" (UniqueName: \"kubernetes.io/projected/77aa02e7-f074-430f-bb6c-d35c496b1988-kube-api-access-79nmv\") pod \"aws-ebs-csi-driver-node-6hvg4\" (UID: \"77aa02e7-f074-430f-bb6c-d35c496b1988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.570918 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.570879 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrxbs" May 21 20:20:46.580761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.580728 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmk8j" May 21 20:20:46.591590 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.591558 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57vbn" May 21 20:20:46.597556 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.597507 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dqtt" May 21 20:20:46.606831 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.606800 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" May 21 20:20:46.614631 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.614596 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:20:46.623472 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.623437 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:20:46.628241 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.628203 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" May 21 20:20:46.889322 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.889274 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:46.889509 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.889431 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:46.889509 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.889506 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:47.889484568 +0000 UTC m=+4.117431998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:46.990431 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:46.990396 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:46.990566 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.990523 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:46.990566 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.990541 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:46.990566 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.990554 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:46.990689 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:46.990605 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:47.990592684 +0000 UTC m=+4.218540094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:47.049249 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.049217 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b04e2e4_9a63_46ba_99d3_abb3af641249.slice/crio-a9d53539fa45b9d9814a66c616faf196a00b2976801cb814e01ad4f955f6cd40 WatchSource:0}: Error finding container a9d53539fa45b9d9814a66c616faf196a00b2976801cb814e01ad4f955f6cd40: Status 404 returned error can't find the container with id a9d53539fa45b9d9814a66c616faf196a00b2976801cb814e01ad4f955f6cd40 May 21 20:20:47.050509 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.050481 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598641f6_a843_45ee_bbb8_3a13d707e78e.slice/crio-43effa755dff603bf2778dae9f7e39f1782424aa44173ac48fb722de4fdbadc6 WatchSource:0}: Error finding container 43effa755dff603bf2778dae9f7e39f1782424aa44173ac48fb722de4fdbadc6: Status 404 returned error can't find the container with id 43effa755dff603bf2778dae9f7e39f1782424aa44173ac48fb722de4fdbadc6 May 21 20:20:47.051655 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.051636 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a171f00_4152_4a3b_852d_308a9783ec5e.slice/crio-4b1b76e0ba782238c06208c39b7b3cdec4997df49a279c45324a59f6b00bf1f8 WatchSource:0}: Error finding container 4b1b76e0ba782238c06208c39b7b3cdec4997df49a279c45324a59f6b00bf1f8: Status 404 returned error can't find the container with id 4b1b76e0ba782238c06208c39b7b3cdec4997df49a279c45324a59f6b00bf1f8 May 21 20:20:47.053481 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.053459 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f71580_60d7_4a17_ac67_edb1ba57e4f1.slice/crio-12208f92c388371cc7af1c4967bfaae0c1efe99df3091bb696cdac6a1c62186b WatchSource:0}: Error finding container 12208f92c388371cc7af1c4967bfaae0c1efe99df3091bb696cdac6a1c62186b: Status 404 returned error can't find the container with id 12208f92c388371cc7af1c4967bfaae0c1efe99df3091bb696cdac6a1c62186b May 21 20:20:47.056308 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.056281 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77aa02e7_f074_430f_bb6c_d35c496b1988.slice/crio-92752bdb7bc23c318a8b644816002166bb4684c95383cc1cbd4f35b8af62cb57 WatchSource:0}: Error finding container 92752bdb7bc23c318a8b644816002166bb4684c95383cc1cbd4f35b8af62cb57: Status 404 returned error can't find the container with id 92752bdb7bc23c318a8b644816002166bb4684c95383cc1cbd4f35b8af62cb57 May 21 20:20:47.058652 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.058630 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080f4e4a_bf3c_4024_975a_8d3fe14d3146.slice/crio-3e787b5a72d463e938bfd8cba3990084f580a6c93ea11c05be79a97e85b2f9e9 WatchSource:0}: Error finding container 3e787b5a72d463e938bfd8cba3990084f580a6c93ea11c05be79a97e85b2f9e9: Status 404 returned error can't find the container with id 3e787b5a72d463e938bfd8cba3990084f580a6c93ea11c05be79a97e85b2f9e9 May 21 20:20:47.059586 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.059561 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0646be_be5c_4d1a_8b47_a05776491aea.slice/crio-d655f8f744511fd0c947f05e4cbfadf2bd1d85f94ad4b7294dba8108365fb905 WatchSource:0}: Error finding container d655f8f744511fd0c947f05e4cbfadf2bd1d85f94ad4b7294dba8108365fb905: Status 404 returned error can't find the container with id d655f8f744511fd0c947f05e4cbfadf2bd1d85f94ad4b7294dba8108365fb905 May 21 20:20:47.060034 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:20:47.060000 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df3c901_7e72_45e4_b14a_5ef84c6f060d.slice/crio-8da4d8649e2f39a4c4f2151f026a78a205be5669af7ef4be96e6b32a7bd1aace WatchSource:0}: Error finding container 8da4d8649e2f39a4c4f2151f026a78a205be5669af7ef4be96e6b32a7bd1aace: Status 404 returned error can't find the container with id 8da4d8649e2f39a4c4f2151f026a78a205be5669af7ef4be96e6b32a7bd1aace May 21 20:20:47.330321 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.330121 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:15:45 +0000 UTC" deadline="2028-02-19 01:36:11.15862636 +0000 UTC" May 21 20:20:47.330321 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.330316 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15317h15m23.828313253s" May 21 20:20:47.381346 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.381313 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" event={"ID":"218dda9ded7f9e55e144b6f5a2217224","Type":"ContainerStarted","Data":"f7cde82e2e748a2e2509186c12a9c92c7fe72cfd2e4a4853a548ac2fadc12eb3"} May 21 20:20:47.382322 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.382297 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerStarted","Data":"d655f8f744511fd0c947f05e4cbfadf2bd1d85f94ad4b7294dba8108365fb905"} May 21 20:20:47.383291 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.383260 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dqtt" event={"ID":"080f4e4a-bf3c-4024-975a-8d3fe14d3146","Type":"ContainerStarted","Data":"3e787b5a72d463e938bfd8cba3990084f580a6c93ea11c05be79a97e85b2f9e9"} May 21 20:20:47.384133 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.384112 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" event={"ID":"77aa02e7-f074-430f-bb6c-d35c496b1988","Type":"ContainerStarted","Data":"92752bdb7bc23c318a8b644816002166bb4684c95383cc1cbd4f35b8af62cb57"} May 21 20:20:47.385069 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.385048 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57vbn" event={"ID":"13f71580-60d7-4a17-ac67-edb1ba57e4f1","Type":"ContainerStarted","Data":"12208f92c388371cc7af1c4967bfaae0c1efe99df3091bb696cdac6a1c62186b"} May 21 20:20:47.386020 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.386001 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6xrrl" event={"ID":"598641f6-a843-45ee-bbb8-3a13d707e78e","Type":"ContainerStarted","Data":"43effa755dff603bf2778dae9f7e39f1782424aa44173ac48fb722de4fdbadc6"} May 21 20:20:47.386930 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.386914 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrxbs" event={"ID":"9b04e2e4-9a63-46ba-99d3-abb3af641249","Type":"ContainerStarted","Data":"a9d53539fa45b9d9814a66c616faf196a00b2976801cb814e01ad4f955f6cd40"} May 21 20:20:47.388180 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.388160 2551 generic.go:358] "Generic (PLEG): container finished" podID="1178cee131de9f92e03e50170cefe7e8" containerID="4790c15d5aa4ca9af06b61c67de79a54ef3b5df7c0cea0feb40c4860b6af1682" exitCode=0 May 21 20:20:47.388267 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.388215 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" event={"ID":"1178cee131de9f92e03e50170cefe7e8","Type":"ContainerDied","Data":"4790c15d5aa4ca9af06b61c67de79a54ef3b5df7c0cea0feb40c4860b6af1682"} May 21 20:20:47.389234 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.389216 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmk8j" event={"ID":"6df3c901-7e72-45e4-b14a-5ef84c6f060d","Type":"ContainerStarted","Data":"8da4d8649e2f39a4c4f2151f026a78a205be5669af7ef4be96e6b32a7bd1aace"} May 21 20:20:47.390307 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.390284 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"4b1b76e0ba782238c06208c39b7b3cdec4997df49a279c45324a59f6b00bf1f8"} May 21 20:20:47.405322 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.405269 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-74.ec2.internal" podStartSLOduration=2.405248223 podStartE2EDuration="2.405248223s" podCreationTimestamp="2026-05-21 20:20:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:20:47.393670454 +0000 UTC m=+3.621617886" watchObservedRunningTime="2026-05-21 20:20:47.405248223 +0000 UTC m=+3.633195655" May 21 20:20:47.896895 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.896856 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:47.897095 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.897035 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:47.897154 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.897099 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:49.897080502 +0000 UTC m=+6.125027916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:47.998542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:47.997887 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:47.998542 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.998080 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:47.998542 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.998101 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:47.998542 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.998115 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:47.998542 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:47.998176 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:49.998158172 +0000 UTC m=+6.226105588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:48.375695 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:48.374994 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:48.375695 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:48.375127 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:48.375695 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:48.375554 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:48.375695 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:48.375642 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:48.410020 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:48.409815 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" event={"ID":"1178cee131de9f92e03e50170cefe7e8","Type":"ContainerStarted","Data":"756294a6572c413678e5f6e935169bc7b9d4407fb00c713b2ce2bc292686fad5"} May 21 20:20:48.430991 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:48.430933 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-74.ec2.internal" podStartSLOduration=3.430914656 podStartE2EDuration="3.430914656s" podCreationTimestamp="2026-05-21 20:20:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:20:48.430158579 +0000 UTC m=+4.658106012" watchObservedRunningTime="2026-05-21 20:20:48.430914656 +0000 UTC m=+4.658862090" May 21 20:20:49.914710 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:49.914667 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:49.915253 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:49.914828 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:49.915253 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:49.914911 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:53.91489363 +0000 UTC m=+10.142841045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:50.015891 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:50.015443 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:50.015891 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.015581 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:50.015891 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.015597 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:50.015891 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.015607 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:50.015891 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.015653 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:54.015640667 +0000 UTC m=+10.243588080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:50.372316 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:50.372278 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:50.372507 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.372435 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:50.372980 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:50.372956 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:50.373092 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:50.373061 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:52.373026 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:52.372992 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:52.373516 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:52.373121 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:52.373516 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:52.372992 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:52.373516 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:52.373242 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:53.951107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:53.951064 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:53.951577 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:53.951243 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:53.951577 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:53.951309 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:01.951290309 +0000 UTC m=+18.179237723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:54.051817 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.051778 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:54.052048 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.052022 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:54.052048 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.052051 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:54.052164 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.052065 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:54.052164 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.052133 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:02.052114996 +0000 UTC m=+18.280062407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:54.373876 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.373248 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:54.373876 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.373381 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:54.373876 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.373722 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:54.373876 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.373814 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:54.757309 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.757219 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-54d7d"] May 21 20:20:54.763419 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.763393 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.763563 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.763484 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:20:54.856673 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.856628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-dbus\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.856871 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.856734 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.856871 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.856790 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-kubelet-config\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.957564 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-dbus\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.957615 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.957666 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-kubelet-config\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.957771 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-kubelet-config\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:54.957934 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3791107-c06c-44a7-b20f-528923ee1888-dbus\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.958033 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:20:54.958289 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:54.958093 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:55.458072912 +0000 UTC m=+11.686020338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:20:55.461913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:55.461874 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:55.462088 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:55.462068 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:20:55.462167 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:55.462134 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:56.46211367 +0000 UTC m=+12.690061100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:20:56.372334 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:56.372290 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:56.372758 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:56.372336 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:56.372758 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:56.372389 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:56.372758 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:56.372514 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:20:56.372758 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:56.372656 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:56.372937 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:56.372769 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:56.470052 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:56.470015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:56.470196 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:56.470140 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:20:56.470259 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:56.470198 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:58.470184218 +0000 UTC m=+14.698131628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:20:58.372396 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:58.372357 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:58.372977 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:58.372358 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:20:58.372977 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:58.372488 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:20:58.372977 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:58.372358 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:20:58.372977 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:58.372548 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:20:58.372977 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:58.372614 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:20:58.483353 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:20:58.483319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:20:58.483551 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:58.483477 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:20:58.483551 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:20:58.483547 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:02.483527495 +0000 UTC m=+18.711474914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:00.372774 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:00.372736 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:00.373240 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:00.372736 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:00.373240 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:00.372885 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:00.373240 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:00.372884 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:00.373240 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:00.372958 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:00.373240 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:00.373145 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:02.009755 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.009714 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:02.010163 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.009872 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:02.010163 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.009949 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.009927486 +0000 UTC m=+34.237874946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:02.110776 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.110731 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:02.110936 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.110904 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:21:02.110936 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.110925 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:21:02.111037 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.110938 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:02.111037 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.111002 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.110985766 +0000 UTC m=+34.338933177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:02.372024 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.371982 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:02.372218 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.371983 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:02.372218 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.372113 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:02.372218 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.372116 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:02.372218 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.372179 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:02.372422 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.372272 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:02.514684 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:02.514650 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:02.514906 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.514766 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:02.514906 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:02.514836 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:10.514817128 +0000 UTC m=+26.742764617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:04.373496 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:04.373464 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:04.373913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:04.373526 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:04.373913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:04.373601 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:04.373913 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:04.373601 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:04.373913 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:04.373672 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:04.373913 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:04.373772 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:06.372235 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.371905 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:06.373170 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.371903 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:06.373170 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:06.372310 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:06.373170 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.371937 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:06.373170 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:06.372384 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:06.373170 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:06.372461 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:06.443534 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.443497 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="7774988428d383f9f873218ac06a917b0ab5b1ffc7ed5710e6b678c209a20e92" exitCode=0 May 21 20:21:06.443712 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.443585 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"7774988428d383f9f873218ac06a917b0ab5b1ffc7ed5710e6b678c209a20e92"} May 21 20:21:06.444895 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.444865 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dqtt" event={"ID":"080f4e4a-bf3c-4024-975a-8d3fe14d3146","Type":"ContainerStarted","Data":"e57b4d9bfd5056e631f509da58b3fa43ac025ffd40a41e9bb5759efb55958031"} May 21 20:21:06.449501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.449469 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" event={"ID":"77aa02e7-f074-430f-bb6c-d35c496b1988","Type":"ContainerStarted","Data":"e1a62a41970456023f383a156868471955e75573aaea8370c7b51dd2bf5c8c67"} May 21 20:21:06.451864 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.451823 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57vbn" event={"ID":"13f71580-60d7-4a17-ac67-edb1ba57e4f1","Type":"ContainerStarted","Data":"b71005f0c17fd569956f411d7d8c5cc505c4c0bc8ec17ef0a8911239278d1415"} May 21 20:21:06.453124 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.453104 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6xrrl" event={"ID":"598641f6-a843-45ee-bbb8-3a13d707e78e","Type":"ContainerStarted","Data":"fb18610d8a37476168198e8595892e44069f8dc8bad54751095aa9b38e919d40"} May 21 20:21:06.454301 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.454278 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrxbs" event={"ID":"9b04e2e4-9a63-46ba-99d3-abb3af641249","Type":"ContainerStarted","Data":"1201eac004d65db6b019ad0aaf36d87f5cdec37b82f21bac2d68a8c38530fa13"} May 21 20:21:06.456424 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456407 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:21:06.456682 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456661 2551 generic.go:358] "Generic (PLEG): container finished" podID="2a171f00-4152-4a3b-852d-308a9783ec5e" containerID="b67fa110bd738d6bb78b3a69e4d09c97a749e22f3ec3583cadb6f0545594fce0" exitCode=1 May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456684 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"05496a4d4986e004f6207ce41e5478321d244933e77e3ac91e04ff708de2cec2"} May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456704 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"df3a2634afbceb2bec39992cb943d0b212eef715f859e2438ec14a328090c94b"} May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456713 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"2f94c1d0ba95d471328b2113f2c544a24e23e13b976886328a9a647e1f341782"} May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456721 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"28a9573e4134f9138e531f331df54efa4e2fd7154ed6ecbeb12968564f4156dd"} May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456729 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerDied","Data":"b67fa110bd738d6bb78b3a69e4d09c97a749e22f3ec3583cadb6f0545594fce0"} May 21 20:21:06.456743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.456738 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"71c0a7685d3cdf097677792eec8cfd437d384bfd1d1065fa9796b0a97892f53d"} May 21 20:21:06.471916 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.471867 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6xrrl" podStartSLOduration=4.194132523 podStartE2EDuration="22.4718327s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.05332513 +0000 UTC m=+3.281272541" lastFinishedPulling="2026-05-21 20:21:05.331025305 +0000 UTC m=+21.558972718" observedRunningTime="2026-05-21 20:21:06.471263923 +0000 UTC m=+22.699211354" watchObservedRunningTime="2026-05-21 20:21:06.4718327 +0000 UTC m=+22.699780132" May 21 20:21:06.481608 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.481563 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lrxbs" podStartSLOduration=4.235302054 podStartE2EDuration="22.481551189s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.051866373 +0000 UTC m=+3.279813783" lastFinishedPulling="2026-05-21 20:21:05.298115497 +0000 UTC m=+21.526062918" observedRunningTime="2026-05-21 20:21:06.481298628 +0000 UTC m=+22.709246058" watchObservedRunningTime="2026-05-21 20:21:06.481551189 +0000 UTC m=+22.709498620" May 21 20:21:06.492549 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.492502 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-57vbn" podStartSLOduration=4.250109627 podStartE2EDuration="22.492486272s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.055737519 +0000 UTC m=+3.283684934" lastFinishedPulling="2026-05-21 20:21:05.298114165 +0000 UTC m=+21.526061579" observedRunningTime="2026-05-21 20:21:06.492354043 +0000 UTC m=+22.720301485" watchObservedRunningTime="2026-05-21 20:21:06.492486272 +0000 UTC m=+22.720433704" May 21 20:21:06.506253 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.506209 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4dqtt" podStartSLOduration=4.228502043 podStartE2EDuration="22.506196557s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.059894782 +0000 UTC m=+3.287842193" lastFinishedPulling="2026-05-21 20:21:05.33758928 +0000 UTC m=+21.565536707" observedRunningTime="2026-05-21 20:21:06.505777005 +0000 UTC m=+22.733724436" watchObservedRunningTime="2026-05-21 20:21:06.506196557 +0000 UTC m=+22.734143988" May 21 20:21:06.815650 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:06.815621 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 20:21:07.358859 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.358723 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T20:21:06.815640947Z","UUID":"64bfdb8e-9d37-4894-ae2f-6bc13768f19a","Handler":null,"Name":"","Endpoint":""} May 21 20:21:07.360935 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.360899 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 20:21:07.360935 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.360932 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 20:21:07.460417 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.460354 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmk8j" event={"ID":"6df3c901-7e72-45e4-b14a-5ef84c6f060d","Type":"ContainerStarted","Data":"a7e03a3431bc460819893b76dc48894217c7f1090481a1f6cb402ed421660650"} May 21 20:21:07.462136 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.462105 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" event={"ID":"77aa02e7-f074-430f-bb6c-d35c496b1988","Type":"ContainerStarted","Data":"2eba1d8e69b3fcb5da723b0fb00c398e262763176fb2b2acf6b6a28dfe1d2850"} May 21 20:21:07.485161 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:07.485085 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hmk8j" podStartSLOduration=5.216435067 podStartE2EDuration="23.485064728s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.062345901 +0000 UTC m=+3.290293311" lastFinishedPulling="2026-05-21 20:21:05.330975554 +0000 UTC m=+21.558922972" observedRunningTime="2026-05-21 20:21:07.484547024 +0000 UTC m=+23.712494458" watchObservedRunningTime="2026-05-21 20:21:07.485064728 +0000 UTC m=+23.713012162" May 21 20:21:08.372914 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.372812 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:08.373081 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.372936 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:08.373081 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:08.372939 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:08.373081 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.372962 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:08.373081 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:08.373043 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:08.373241 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:08.373138 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:08.466897 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.466866 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:21:08.467361 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.467225 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"66f869688e4ff5ddd49921fed29fb491f4196e76128d255515cc88f6babfe699"} May 21 20:21:08.469095 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.469068 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" event={"ID":"77aa02e7-f074-430f-bb6c-d35c496b1988","Type":"ContainerStarted","Data":"58b10f692ebc0241ea7afafe0be6e667b69a4adf26e9a60b83b96709c3408c4c"} May 21 20:21:08.489422 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:08.489375 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6hvg4" podStartSLOduration=3.696347609 podStartE2EDuration="24.489358474s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.059873415 +0000 UTC m=+3.287820825" lastFinishedPulling="2026-05-21 20:21:07.852884276 +0000 UTC m=+24.080831690" observedRunningTime="2026-05-21 20:21:08.489248937 +0000 UTC m=+24.717196369" watchObservedRunningTime="2026-05-21 20:21:08.489358474 +0000 UTC m=+24.717305906" May 21 20:21:10.357044 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.356824 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:21:10.357796 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.357781 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:21:10.375042 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.375020 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:10.375187 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.375027 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:10.375187 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:10.375159 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:10.375295 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.375030 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:10.375295 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:10.375216 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:10.375295 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:10.375272 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:10.477883 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.477836 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:21:10.478293 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.478241 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"cbbf495199574b4e3095ec3b17c34797ca69c09a6e00706cf0a6256825a005ee"} May 21 20:21:10.478790 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.478765 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:10.478905 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.478794 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:10.478905 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.478805 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:21:10.478905 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.478806 2551 scope.go:117] "RemoveContainer" containerID="b67fa110bd738d6bb78b3a69e4d09c97a749e22f3ec3583cadb6f0545594fce0" May 21 20:21:10.479699 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.479672 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6xrrl" May 21 20:21:10.497096 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.497063 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:10.579642 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.579551 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:10.580276 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:10.580255 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:10.580410 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:10.580335 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret podName:e3791107-c06c-44a7-b20f-528923ee1888 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:26.580319428 +0000 UTC m=+42.808266838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret") pod "global-pull-secret-syncer-54d7d" (UID: "e3791107-c06c-44a7-b20f-528923ee1888") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:10.901912 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.901873 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tdbx6"] May 21 20:21:10.905589 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.905565 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:10.907818 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.907795 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kgfkv\"" May 21 20:21:10.908088 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.908068 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 20:21:10.908799 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.908783 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 20:21:10.983227 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.983184 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bd7604b-3c99-4a48-b36e-baf12a2dad78-hosts-file\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:10.983379 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.983266 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd7604b-3c99-4a48-b36e-baf12a2dad78-tmp-dir\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:10.983379 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:10.983285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4498\" (UniqueName: \"kubernetes.io/projected/4bd7604b-3c99-4a48-b36e-baf12a2dad78-kube-api-access-q4498\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.083692 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.083654 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bd7604b-3c99-4a48-b36e-baf12a2dad78-hosts-file\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.083894 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.083716 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd7604b-3c99-4a48-b36e-baf12a2dad78-tmp-dir\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.083894 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.083738 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4498\" (UniqueName: \"kubernetes.io/projected/4bd7604b-3c99-4a48-b36e-baf12a2dad78-kube-api-access-q4498\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.083894 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.083770 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bd7604b-3c99-4a48-b36e-baf12a2dad78-hosts-file\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.084100 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.084081 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd7604b-3c99-4a48-b36e-baf12a2dad78-tmp-dir\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.092278 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.092253 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4498\" (UniqueName: \"kubernetes.io/projected/4bd7604b-3c99-4a48-b36e-baf12a2dad78-kube-api-access-q4498\") pod \"node-resolver-tdbx6\" (UID: \"4bd7604b-3c99-4a48-b36e-baf12a2dad78\") " pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:11.215517 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:11.215441 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdbx6" May 21 20:21:12.108972 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:12.108937 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd7604b_3c99_4a48_b36e_baf12a2dad78.slice/crio-7f1356f776398b00c3be2695f6dd5f1d5d5367800c9178037685857e5ab771e3 WatchSource:0}: Error finding container 7f1356f776398b00c3be2695f6dd5f1d5d5367800c9178037685857e5ab771e3: Status 404 returned error can't find the container with id 7f1356f776398b00c3be2695f6dd5f1d5d5367800c9178037685857e5ab771e3 May 21 20:21:12.320165 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.319984 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6rq8"] May 21 20:21:12.320327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.320283 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:12.320423 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:12.320403 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:12.322655 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.322624 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgrgl"] May 21 20:21:12.322813 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.322745 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:12.322900 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:12.322874 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:12.323350 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.323324 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54d7d"] May 21 20:21:12.323464 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.323425 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:12.323526 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:12.323492 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:12.483059 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.483031 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdbx6" event={"ID":"4bd7604b-3c99-4a48-b36e-baf12a2dad78","Type":"ContainerStarted","Data":"690ce28264508579cb9c0847eebe83cc4b17af1dbe85f341b74ff7c47d179eda"} May 21 20:21:12.483211 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.483065 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdbx6" event={"ID":"4bd7604b-3c99-4a48-b36e-baf12a2dad78","Type":"ContainerStarted","Data":"7f1356f776398b00c3be2695f6dd5f1d5d5367800c9178037685857e5ab771e3"} May 21 20:21:12.488756 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.488734 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:21:12.489084 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.489064 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" event={"ID":"2a171f00-4152-4a3b-852d-308a9783ec5e","Type":"ContainerStarted","Data":"6d7d2698d30271b6ede2071eb476c2f2b93be399ca383891deb01896a2706ad7"} May 21 20:21:12.489537 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.489518 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:12.497774 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.497733 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tdbx6" podStartSLOduration=2.497718895 podStartE2EDuration="2.497718895s" podCreationTimestamp="2026-05-21 20:21:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:12.497138636 +0000 UTC m=+28.725086069" watchObservedRunningTime="2026-05-21 20:21:12.497718895 +0000 UTC m=+28.725666321" May 21 20:21:12.505625 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.505602 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:12.547130 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:12.547059 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" podStartSLOduration=10.225343836 podStartE2EDuration="28.547042142s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.053906362 +0000 UTC m=+3.281853775" lastFinishedPulling="2026-05-21 20:21:05.375604666 +0000 UTC m=+21.603552081" observedRunningTime="2026-05-21 20:21:12.521961334 +0000 UTC m=+28.749908795" watchObservedRunningTime="2026-05-21 20:21:12.547042142 +0000 UTC m=+28.774989576" May 21 20:21:13.493033 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:13.492951 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="2766aefe3557062343d4d7145ff30155f560b8475712d505fcfb1b1579fa58e4" exitCode=0 May 21 20:21:13.493033 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:13.493022 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"2766aefe3557062343d4d7145ff30155f560b8475712d505fcfb1b1579fa58e4"} May 21 20:21:14.373213 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:14.373189 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:14.373343 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:14.373284 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:14.373406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:14.373367 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:14.374328 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:14.373954 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:14.374328 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:14.374020 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:14.376863 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:14.374556 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:15.498768 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:15.498569 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="62193a3d7f31090b830464c8bcd739964b634090ce14b25f14dda3feccbbb7d6" exitCode=0 May 21 20:21:15.499199 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:15.498656 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"62193a3d7f31090b830464c8bcd739964b634090ce14b25f14dda3feccbbb7d6"} May 21 20:21:16.372548 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:16.372512 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:16.372742 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:16.372615 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54d7d" podUID="e3791107-c06c-44a7-b20f-528923ee1888" May 21 20:21:16.372742 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:16.372621 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:16.372742 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:16.372644 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:16.372742 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:16.372708 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgrgl" podUID="2a0d9808-d358-4c5a-91c9-668f8869d649" May 21 20:21:16.372991 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:16.372771 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6rq8" podUID="71ba3135-325d-465a-ae56-7bb40941ebb2" May 21 20:21:17.504835 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:17.504805 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="2b7d35b89265043650ea1c0440c5fb6b75696e31296d7d812ec8619d10a0f94b" exitCode=0 May 21 20:21:17.505344 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:17.504869 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"2b7d35b89265043650ea1c0440c5fb6b75696e31296d7d812ec8619d10a0f94b"} May 21 20:21:18.044996 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.044953 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:18.045242 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.045132 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:18.045242 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.045221 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs podName:71ba3135-325d-465a-ae56-7bb40941ebb2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.045196724 +0000 UTC m=+66.273144140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs") pod "network-metrics-daemon-c6rq8" (UID: "71ba3135-325d-465a-ae56-7bb40941ebb2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:18.074673 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.074641 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-74.ec2.internal" event="NodeReady" May 21 20:21:18.074936 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.074794 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 20:21:18.105960 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.105921 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp"] May 21 20:21:18.117254 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.117225 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:21:18.117406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.117362 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.120501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.120459 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 20:21:18.120882 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.120836 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 20:21:18.121038 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.120977 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 20:21:18.121038 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.121011 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 20:21:18.121555 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.121507 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xjv9h\"" May 21 20:21:18.125421 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.125402 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp"] May 21 20:21:18.125570 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.125431 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l9qfj"] May 21 20:21:18.125570 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.125561 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.127585 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.127559 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 20:21:18.127820 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.127797 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rt4bw\"" May 21 20:21:18.127934 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.127901 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 20:21:18.127999 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.127960 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 20:21:18.137478 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.134254 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.146136 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8"] May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.146441 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.146502 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.146586 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.146603 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.146612 2551 projected.go:194] Error preparing data for projected volume kube-api-access-2vq7t for pod openshift-network-diagnostics/network-check-target-zgrgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:18.146911 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.146865 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t podName:2a0d9808-d358-4c5a-91c9-668f8869d649 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.146652777 +0000 UTC m=+66.374600186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vq7t" (UniqueName: "kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t") pod "network-check-target-zgrgl" (UID: "2a0d9808-d358-4c5a-91c9-668f8869d649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:18.148746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.148724 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 20:21:18.148888 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.148784 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h49gp\"" May 21 20:21:18.148982 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.148963 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 20:21:18.162215 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.162189 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d"] May 21 20:21:18.162347 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.162331 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.164739 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.164710 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 20:21:18.164980 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.164960 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 20:21:18.165057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.164970 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m46lj\"" May 21 20:21:18.180338 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.180313 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:21:18.180471 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.180349 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s2jxr"] May 21 20:21:18.180531 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.180476 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" May 21 20:21:18.182512 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.182461 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:21:18.182652 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.182628 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:21:18.182754 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.182655 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-544xx\"" May 21 20:21:18.191047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.191027 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l9qfj"] May 21 20:21:18.191169 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.191052 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d"] May 21 20:21:18.191169 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.191065 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8"] May 21 20:21:18.191169 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.191081 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2jxr"] May 21 20:21:18.191274 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.191178 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.193423 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.193202 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 20:21:18.193423 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.193246 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 20:21:18.193423 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.193264 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4t59k\"" May 21 20:21:18.193423 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.193319 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 20:21:18.247190 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn5wk\" (UniqueName: \"kubernetes.io/projected/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-kube-api-access-tn5wk\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.247190 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247157 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247241 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247282 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247354 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-config-volume\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.247433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247388 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df68f186-06a9-4589-a97c-06ad9cc647c2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.247433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247427 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247507 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247549 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-tmp-dir\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247580 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-kube-api-access-7gnz2\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247606 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247632 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247681 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247660 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.247958 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247711 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-serving-cert\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.247958 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-config\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.247958 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247768 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.247958 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.247793 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vdc\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.348436 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348395 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-serving-cert\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.348436 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348436 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-config\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.348663 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348458 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.348663 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348488 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vdc\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.348767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348668 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tn5wk\" (UniqueName: \"kubernetes.io/projected/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-kube-api-access-tn5wk\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.348767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348714 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9hs\" (UniqueName: \"kubernetes.io/projected/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-kube-api-access-7b9hs\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.348910 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348764 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.348910 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348831 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.348910 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348888 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.349057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348923 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-config-volume\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348950 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df68f186-06a9-4589-a97c-06ad9cc647c2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.349057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.348987 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.349057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349022 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349070 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349079 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-config\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349106 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-tmp-dir\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349138 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-kube-api-access-7gnz2\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349164 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349189 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.349202 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.349218 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349219 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.349250 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349248 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx44t\" (UniqueName: \"kubernetes.io/projected/9e7994f0-b1dd-4977-9157-60635f4dea53-kube-api-access-tx44t\") pod \"network-check-source-7f44b6dd87-vr75d\" (UID: \"9e7994f0-b1dd-4977-9157-60635f4dea53\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" May 21 20:21:18.349709 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.349275 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.849258316 +0000 UTC m=+35.077205745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:18.349709 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349396 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.349709 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349533 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-config-volume\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349709 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349551 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-tmp-dir\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.349953 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349919 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df68f186-06a9-4589-a97c-06ad9cc647c2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.350008 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.349970 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.350066 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.350007 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:18.350066 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.350060 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.85004569 +0000 UTC m=+35.077993103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:18.350177 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.350071 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:18.350177 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.350124 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.85010829 +0000 UTC m=+35.078055702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:18.350494 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.350469 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.353761 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.353742 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.353879 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.353825 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.357125 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.357100 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vdc\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.357637 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.357597 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn5wk\" (UniqueName: \"kubernetes.io/projected/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-kube-api-access-tn5wk\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.358292 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.358273 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/050a54f2-c57b-4e92-b2dc-0527d0d1c6df-serving-cert\") pod \"service-ca-operator-57b5b68b8-c4rtp\" (UID: \"050a54f2-c57b-4e92-b2dc-0527d0d1c6df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.361219 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.361197 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-kube-api-access-7gnz2\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.361613 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.361592 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.373108 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.372642 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:18.373108 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.372674 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:18.373108 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.372717 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:18.375435 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.375324 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 20:21:18.375435 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.375368 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kwprk\"" May 21 20:21:18.375630 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.375603 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stvkr\"" May 21 20:21:18.375744 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.375732 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:21:18.433664 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.433633 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" May 21 20:21:18.450964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.450906 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9hs\" (UniqueName: \"kubernetes.io/projected/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-kube-api-access-7b9hs\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.451137 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.450995 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.451137 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.451061 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx44t\" (UniqueName: \"kubernetes.io/projected/9e7994f0-b1dd-4977-9157-60635f4dea53-kube-api-access-tx44t\") pod \"network-check-source-7f44b6dd87-vr75d\" (UID: \"9e7994f0-b1dd-4977-9157-60635f4dea53\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" May 21 20:21:18.451265 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.451148 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:18.451265 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.451202 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:18.951187278 +0000 UTC m=+35.179134693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:18.460786 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.460756 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx44t\" (UniqueName: \"kubernetes.io/projected/9e7994f0-b1dd-4977-9157-60635f4dea53-kube-api-access-tx44t\") pod \"network-check-source-7f44b6dd87-vr75d\" (UID: \"9e7994f0-b1dd-4977-9157-60635f4dea53\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" May 21 20:21:18.460985 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.460755 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9hs\" (UniqueName: \"kubernetes.io/projected/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-kube-api-access-7b9hs\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.490670 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.490629 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" May 21 20:21:18.618957 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.618751 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp"] May 21 20:21:18.624431 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:18.624394 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050a54f2_c57b_4e92_b2dc_0527d0d1c6df.slice/crio-f8c7977890a9788e21d20318f4b683fb4805174cb33eceeba74859b8b64a4ec2 WatchSource:0}: Error finding container f8c7977890a9788e21d20318f4b683fb4805174cb33eceeba74859b8b64a4ec2: Status 404 returned error can't find the container with id f8c7977890a9788e21d20318f4b683fb4805174cb33eceeba74859b8b64a4ec2 May 21 20:21:18.648296 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.648264 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d"] May 21 20:21:18.652431 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:18.652398 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7994f0_b1dd_4977_9157_60635f4dea53.slice/crio-31a9b974eb25bb77f7fbb3f232453b4f577a22dbccbfd17e84973ebb404a7f94 WatchSource:0}: Error finding container 31a9b974eb25bb77f7fbb3f232453b4f577a22dbccbfd17e84973ebb404a7f94: Status 404 returned error can't find the container with id 31a9b974eb25bb77f7fbb3f232453b4f577a22dbccbfd17e84973ebb404a7f94 May 21 20:21:18.854138 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.854107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.854158 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.854193 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854283 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854308 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854320 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854340 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854377 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:19.854356785 +0000 UTC m=+36.082304209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:18.854400 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854402 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:19.854384085 +0000 UTC m=+36.082331498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:18.854733 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.854420 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:19.854411328 +0000 UTC m=+36.082358741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:18.955602 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:18.955566 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:18.955826 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.955746 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:18.955826 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:18.955818 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:19.955797919 +0000 UTC m=+36.183745332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:19.511174 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.511132 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" event={"ID":"9e7994f0-b1dd-4977-9157-60635f4dea53","Type":"ContainerStarted","Data":"31a9b974eb25bb77f7fbb3f232453b4f577a22dbccbfd17e84973ebb404a7f94"} May 21 20:21:19.512299 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.512268 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" event={"ID":"050a54f2-c57b-4e92-b2dc-0527d0d1c6df","Type":"ContainerStarted","Data":"f8c7977890a9788e21d20318f4b683fb4805174cb33eceeba74859b8b64a4ec2"} May 21 20:21:19.864002 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.863753 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:19.864459 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.864051 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:19.864459 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.864101 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:19.877271 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877234 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:19.877271 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877271 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:19.877521 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877379 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:21.87733111 +0000 UTC m=+38.105278534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:19.877913 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877890 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:19.878017 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877965 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:21.877947933 +0000 UTC m=+38.105895343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:19.878017 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.877970 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:19.878129 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.878051 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:21.878031832 +0000 UTC m=+38.105979247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:19.965547 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:19.965499 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:19.965765 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.965747 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:19.965834 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:19.965816 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:21.965796093 +0000 UTC m=+38.193743527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:21.881767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:21.881722 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:21.881797 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:21.881835 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882038 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882089 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:25.882075559 +0000 UTC m=+42.110022968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882140 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882148 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:21.882194 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882169 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:25.882162358 +0000 UTC m=+42.110109767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:21.882416 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882208 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:21.882416 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.882226 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:25.882221025 +0000 UTC m=+42.110168434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:21.983264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:21.983231 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:21.983451 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.983401 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:21.983502 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:21.983485 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:25.983463723 +0000 UTC m=+42.211411140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:23.837415 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.837369 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn"] May 21 20:21:23.873475 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.873441 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6"] May 21 20:21:23.873659 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.873612 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:23.876241 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.876215 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 20:21:23.876241 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.876224 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gxccc\"" May 21 20:21:23.876427 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.876224 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 20:21:23.877251 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.877227 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 20:21:23.877358 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.877229 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 20:21:23.889499 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.889475 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz"] May 21 20:21:23.889643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.889529 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:23.891642 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.891620 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 20:21:23.909621 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.909597 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn"] May 21 20:21:23.909767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.909627 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6"] May 21 20:21:23.909767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.909643 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz"] May 21 20:21:23.909767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.909748 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:23.914441 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.912282 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 20:21:23.914441 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.912630 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 20:21:23.914441 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.912719 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 20:21:23.914441 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:23.912795 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 20:21:24.001093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.001057 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d0b64a1-69cd-4d30-8f7b-004fb454c308-klusterlet-config\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.001300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.001246 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0b64a1-69cd-4d30-8f7b-004fb454c308-tmp\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.001407 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.001379 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.001528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.001422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkcxk\" (UniqueName: \"kubernetes.io/projected/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-kube-api-access-bkcxk\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.001528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.001452 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7snr\" (UniqueName: \"kubernetes.io/projected/9d0b64a1-69cd-4d30-8f7b-004fb454c308-kube-api-access-r7snr\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.102466 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102423 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.102657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102497 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.102657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102527 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.102657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.102657 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102644 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.102904 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102677 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7snr\" (UniqueName: \"kubernetes.io/projected/9d0b64a1-69cd-4d30-8f7b-004fb454c308-kube-api-access-r7snr\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.102904 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102704 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgn5l\" (UniqueName: \"kubernetes.io/projected/158a2894-1b07-492a-8686-15e484b8c660-kube-api-access-mgn5l\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.102904 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102876 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0b64a1-69cd-4d30-8f7b-004fb454c308-tmp\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.103064 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102926 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkcxk\" (UniqueName: \"kubernetes.io/projected/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-kube-api-access-bkcxk\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.103064 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.102972 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/158a2894-1b07-492a-8686-15e484b8c660-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.103064 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.103015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d0b64a1-69cd-4d30-8f7b-004fb454c308-klusterlet-config\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.106923 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.106890 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d0b64a1-69cd-4d30-8f7b-004fb454c308-klusterlet-config\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.107053 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.106893 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.111075 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.111048 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkcxk\" (UniqueName: \"kubernetes.io/projected/95e858c6-524b-46a0-ac03-dfe1bd2cdc90-kube-api-access-bkcxk\") pod \"managed-serviceaccount-addon-agent-658d4c458d-7j6bn\" (UID: \"95e858c6-524b-46a0-ac03-dfe1bd2cdc90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.111326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.111307 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7snr\" (UniqueName: \"kubernetes.io/projected/9d0b64a1-69cd-4d30-8f7b-004fb454c308-kube-api-access-r7snr\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.116305 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.116278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0b64a1-69cd-4d30-8f7b-004fb454c308-tmp\") pod \"klusterlet-addon-workmgr-66cb5db6f5-2lsz6\" (UID: \"9d0b64a1-69cd-4d30-8f7b-004fb454c308\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.193979 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.193942 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" May 21 20:21:24.203902 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.203871 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:24.204052 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204025 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgn5l\" (UniqueName: \"kubernetes.io/projected/158a2894-1b07-492a-8686-15e484b8c660-kube-api-access-mgn5l\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.204135 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204118 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/158a2894-1b07-492a-8686-15e484b8c660-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.204188 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204156 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.204236 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204190 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.204236 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204214 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.204327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204245 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.205020 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.204950 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/158a2894-1b07-492a-8686-15e484b8c660-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.207264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.207235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.207403 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.207358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-ca\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.207475 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.207407 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.207579 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.207558 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158a2894-1b07-492a-8686-15e484b8c660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.211563 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.211538 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgn5l\" (UniqueName: \"kubernetes.io/projected/158a2894-1b07-492a-8686-15e484b8c660-kube-api-access-mgn5l\") pod \"cluster-proxy-proxy-agent-55d5d755d9-557mz\" (UID: \"158a2894-1b07-492a-8686-15e484b8c660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.221675 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.221277 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:21:24.816101 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.816018 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz"] May 21 20:21:24.822627 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:24.822583 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod158a2894_1b07_492a_8686_15e484b8c660.slice/crio-593a11b3f7cc3e97b9c477ff62b27a4b6dcf22ffdaa1c05d8c66cc004eacf8ed WatchSource:0}: Error finding container 593a11b3f7cc3e97b9c477ff62b27a4b6dcf22ffdaa1c05d8c66cc004eacf8ed: Status 404 returned error can't find the container with id 593a11b3f7cc3e97b9c477ff62b27a4b6dcf22ffdaa1c05d8c66cc004eacf8ed May 21 20:21:24.832368 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.832303 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6"] May 21 20:21:24.837476 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:24.837448 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0b64a1_69cd_4d30_8f7b_004fb454c308.slice/crio-6109bec11a3b5ab2191e974d62753d8956f3eb03cf2dc5da5e603d16a7630e33 WatchSource:0}: Error finding container 6109bec11a3b5ab2191e974d62753d8956f3eb03cf2dc5da5e603d16a7630e33: Status 404 returned error can't find the container with id 6109bec11a3b5ab2191e974d62753d8956f3eb03cf2dc5da5e603d16a7630e33 May 21 20:21:24.851978 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:24.851928 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn"] May 21 20:21:24.856229 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:24.856200 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95e858c6_524b_46a0_ac03_dfe1bd2cdc90.slice/crio-2e70b9535e44aaf8d785742a3b4268a7152e89fe0604b71f0bf3e573409cee02 WatchSource:0}: Error finding container 2e70b9535e44aaf8d785742a3b4268a7152e89fe0604b71f0bf3e573409cee02: Status 404 returned error can't find the container with id 2e70b9535e44aaf8d785742a3b4268a7152e89fe0604b71f0bf3e573409cee02 May 21 20:21:25.527012 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.526975 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" event={"ID":"9e7994f0-b1dd-4977-9157-60635f4dea53","Type":"ContainerStarted","Data":"6f81343d3d8888a9c675fe11196c6d25c628cffdd1595d7e46ae5b346f94fae7"} May 21 20:21:25.529833 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.529800 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="89daf6cc945316a355d0a276ef75e356038139b5145bb1811cde42c11500c7d0" exitCode=0 May 21 20:21:25.529998 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.529899 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"89daf6cc945316a355d0a276ef75e356038139b5145bb1811cde42c11500c7d0"} May 21 20:21:25.535266 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.534229 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" event={"ID":"050a54f2-c57b-4e92-b2dc-0527d0d1c6df","Type":"ContainerStarted","Data":"793921444bd5cf5c55a168bde111a50bdab53c073f064c13244563f1745ec10c"} May 21 20:21:25.536645 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.536617 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" event={"ID":"95e858c6-524b-46a0-ac03-dfe1bd2cdc90","Type":"ContainerStarted","Data":"2e70b9535e44aaf8d785742a3b4268a7152e89fe0604b71f0bf3e573409cee02"} May 21 20:21:25.538905 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.538776 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerStarted","Data":"593a11b3f7cc3e97b9c477ff62b27a4b6dcf22ffdaa1c05d8c66cc004eacf8ed"} May 21 20:21:25.540328 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.540296 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" event={"ID":"9d0b64a1-69cd-4d30-8f7b-004fb454c308","Type":"ContainerStarted","Data":"6109bec11a3b5ab2191e974d62753d8956f3eb03cf2dc5da5e603d16a7630e33"} May 21 20:21:25.543424 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.543378 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vr75d" podStartSLOduration=34.544612551 podStartE2EDuration="40.543361758s" podCreationTimestamp="2026-05-21 20:20:45 +0000 UTC" firstStartedPulling="2026-05-21 20:21:18.654463998 +0000 UTC m=+34.882411408" lastFinishedPulling="2026-05-21 20:21:24.653213199 +0000 UTC m=+40.881160615" observedRunningTime="2026-05-21 20:21:25.542407355 +0000 UTC m=+41.770354786" watchObservedRunningTime="2026-05-21 20:21:25.543361758 +0000 UTC m=+41.771309191" May 21 20:21:25.591417 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.588712 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" podStartSLOduration=35.562328824 podStartE2EDuration="41.588691373s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:21:18.626800936 +0000 UTC m=+34.854748347" lastFinishedPulling="2026-05-21 20:21:24.653163472 +0000 UTC m=+40.881110896" observedRunningTime="2026-05-21 20:21:25.564402841 +0000 UTC m=+41.792350273" watchObservedRunningTime="2026-05-21 20:21:25.588691373 +0000 UTC m=+41.816638807" May 21 20:21:25.923830 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.923788 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:25.924327 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924015 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:25.924327 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924032 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:25.924327 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924093 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:33.924072159 +0000 UTC m=+50.152019574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:25.924538 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.924515 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:25.924599 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:25.924563 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:25.924676 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924663 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:25.924780 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924712 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:33.924699345 +0000 UTC m=+50.152646761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:25.924780 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924767 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:25.924916 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:25.924793 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:33.924783887 +0000 UTC m=+50.152731302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:26.026389 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.026352 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:26.026556 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:26.026467 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:26.026556 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:26.026514 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:34.026501114 +0000 UTC m=+50.254448523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:26.555615 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.553747 2551 generic.go:358] "Generic (PLEG): container finished" podID="dc0646be-be5c-4d1a-8b47-a05776491aea" containerID="d68443129a841fc89fe5ae5c583af5d261289059d9dc8256d25735a99e906d97" exitCode=0 May 21 20:21:26.555615 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.554970 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerDied","Data":"d68443129a841fc89fe5ae5c583af5d261289059d9dc8256d25735a99e906d97"} May 21 20:21:26.632280 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.631211 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:26.635446 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.635382 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3791107-c06c-44a7-b20f-528923ee1888-original-pull-secret\") pod \"global-pull-secret-syncer-54d7d\" (UID: \"e3791107-c06c-44a7-b20f-528923ee1888\") " pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:26.792173 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:26.791739 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54d7d" May 21 20:21:27.022523 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:27.022447 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54d7d"] May 21 20:21:27.561019 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:27.560958 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" event={"ID":"dc0646be-be5c-4d1a-8b47-a05776491aea","Type":"ContainerStarted","Data":"98fd057fa28a160a1bf6c397696119ebd8a2d0f754eab5b675a5a298a1956c1f"} May 21 20:21:27.563448 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:27.563406 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-54d7d" event={"ID":"e3791107-c06c-44a7-b20f-528923ee1888","Type":"ContainerStarted","Data":"e5572ed8841b15ee8a17cd1ccf7013bec91148e69ebabfd819ca2947e0184aed"} May 21 20:21:27.589248 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:27.589188 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zbh5s" podStartSLOduration=5.973292367 podStartE2EDuration="43.58917207s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:20:47.06168639 +0000 UTC m=+3.289633816" lastFinishedPulling="2026-05-21 20:21:24.677566108 +0000 UTC m=+40.905513519" observedRunningTime="2026-05-21 20:21:27.587564235 +0000 UTC m=+43.815511677" watchObservedRunningTime="2026-05-21 20:21:27.58917207 +0000 UTC m=+43.817119709" May 21 20:21:34.005744 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:34.005699 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:34.005744 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:34.005743 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:34.005794 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.005880 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.005932 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.005950 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796f567b68-mrmvf: secret "image-registry-tls" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.005949 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.005959 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls podName:537c94a6-4e4f-4873-90b4-65e7e6a81b1a nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.005941497 +0000 UTC m=+66.233888931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls") pod "dns-default-l9qfj" (UID: "537c94a6-4e4f-4873-90b4-65e7e6a81b1a") : secret "dns-default-metrics-tls" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.006047 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls podName:e8173d9b-a8e1-4919-af0b-b926ee81148d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.006027397 +0000 UTC m=+66.233974821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls") pod "image-registry-796f567b68-mrmvf" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d") : secret "image-registry-tls" not found May 21 20:21:34.006270 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.006065 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert podName:df68f186-06a9-4589-a97c-06ad9cc647c2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.006054441 +0000 UTC m=+66.234001854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-pp4q8" (UID: "df68f186-06a9-4589-a97c-06ad9cc647c2") : secret "networking-console-plugin-cert" not found May 21 20:21:34.106888 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:34.106831 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:34.107064 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.106979 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:34.107064 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:21:34.107045 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert podName:5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:50.107030067 +0000 UTC m=+66.334977481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert") pod "ingress-canary-s2jxr" (UID: "5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9") : secret "canary-serving-cert" not found May 21 20:21:35.586540 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.586503 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" event={"ID":"95e858c6-524b-46a0-ac03-dfe1bd2cdc90","Type":"ContainerStarted","Data":"697b3d0209a351c0194f6cd61b18c89c870f70539ee1b807ce5fa284de571e7c"} May 21 20:21:35.587864 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.587817 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerStarted","Data":"a7c511962cbc213716594dccc627df08335510011647b71ba3ddfac26d942067"} May 21 20:21:35.589199 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.589167 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" event={"ID":"9d0b64a1-69cd-4d30-8f7b-004fb454c308","Type":"ContainerStarted","Data":"558b106f9d2b7e28726c7c04e9b579c84cfd5bc03fdbdafc110ce923e362494c"} May 21 20:21:35.589421 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.589399 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:35.590459 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.590434 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-54d7d" event={"ID":"e3791107-c06c-44a7-b20f-528923ee1888","Type":"ContainerStarted","Data":"6624382dbf818c3545652b44786ddac8858c68038ee2bf345bc261e60f3ba7aa"} May 21 20:21:35.591358 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.591341 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" May 21 20:21:35.601630 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.601589 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658d4c458d-7j6bn" podStartSLOduration=2.86939511 podStartE2EDuration="12.601579344s" podCreationTimestamp="2026-05-21 20:21:23 +0000 UTC" firstStartedPulling="2026-05-21 20:21:24.859174908 +0000 UTC m=+41.087122318" lastFinishedPulling="2026-05-21 20:21:34.591359128 +0000 UTC m=+50.819306552" observedRunningTime="2026-05-21 20:21:35.600639081 +0000 UTC m=+51.828586514" watchObservedRunningTime="2026-05-21 20:21:35.601579344 +0000 UTC m=+51.829526776" May 21 20:21:35.613516 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.613471 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-54d7d" podStartSLOduration=34.004651108 podStartE2EDuration="41.61345425s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:21:27.042009889 +0000 UTC m=+43.269957313" lastFinishedPulling="2026-05-21 20:21:34.650813027 +0000 UTC m=+50.878760455" observedRunningTime="2026-05-21 20:21:35.613214286 +0000 UTC m=+51.841161718" watchObservedRunningTime="2026-05-21 20:21:35.61345425 +0000 UTC m=+51.841401682" May 21 20:21:35.627303 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:35.627236 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66cb5db6f5-2lsz6" podStartSLOduration=2.800018378 podStartE2EDuration="12.627217338s" podCreationTimestamp="2026-05-21 20:21:23 +0000 UTC" firstStartedPulling="2026-05-21 20:21:24.839516388 +0000 UTC m=+41.067463797" lastFinishedPulling="2026-05-21 20:21:34.666715331 +0000 UTC m=+50.894662757" observedRunningTime="2026-05-21 20:21:35.626033216 +0000 UTC m=+51.853980648" watchObservedRunningTime="2026-05-21 20:21:35.627217338 +0000 UTC m=+51.855164770" May 21 20:21:38.600269 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:38.600229 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerStarted","Data":"37717761b1c91dd033368ac205cd8eecfd569149091424dfe321182a522e43ad"} May 21 20:21:38.600673 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:38.600275 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerStarted","Data":"45e8021bd600357a6448ee76bf7e6cea797347e81aee5efb2ea26abc09fcd2f1"} May 21 20:21:38.618007 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:38.617951 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" podStartSLOduration=2.511346562 podStartE2EDuration="15.617934785s" podCreationTimestamp="2026-05-21 20:21:23 +0000 UTC" firstStartedPulling="2026-05-21 20:21:24.825203136 +0000 UTC m=+41.053150553" lastFinishedPulling="2026-05-21 20:21:37.931791365 +0000 UTC m=+54.159738776" observedRunningTime="2026-05-21 20:21:38.617106316 +0000 UTC m=+54.845053750" watchObservedRunningTime="2026-05-21 20:21:38.617934785 +0000 UTC m=+54.845882268" May 21 20:21:44.224507 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:44.224441 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" podUID="158a2894-1b07-492a-8686-15e484b8c660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:21:44.506300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:44.506213 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcncm" May 21 20:21:50.049442 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.049393 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:50.049442 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.049446 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:50.049972 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.049507 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:50.049972 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.049529 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:50.051780 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.051750 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:21:50.052155 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.052134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/537c94a6-4e4f-4873-90b4-65e7e6a81b1a-metrics-tls\") pod \"dns-default-l9qfj\" (UID: \"537c94a6-4e4f-4873-90b4-65e7e6a81b1a\") " pod="openshift-dns/dns-default-l9qfj" May 21 20:21:50.052387 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.052366 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df68f186-06a9-4589-a97c-06ad9cc647c2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-pp4q8\" (UID: \"df68f186-06a9-4589-a97c-06ad9cc647c2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:50.052445 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.052366 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"image-registry-796f567b68-mrmvf\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:50.062071 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.062041 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71ba3135-325d-465a-ae56-7bb40941ebb2-metrics-certs\") pod \"network-metrics-daemon-c6rq8\" (UID: \"71ba3135-325d-465a-ae56-7bb40941ebb2\") " pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:50.150296 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.150252 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:50.150467 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.150304 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:50.153054 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.153018 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9-cert\") pod \"ingress-canary-s2jxr\" (UID: \"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9\") " pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:50.153211 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.153094 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vq7t\" (UniqueName: \"kubernetes.io/projected/2a0d9808-d358-4c5a-91c9-668f8869d649-kube-api-access-2vq7t\") pod \"network-check-target-zgrgl\" (UID: \"2a0d9808-d358-4c5a-91c9-668f8869d649\") " pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:50.187247 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.187216 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stvkr\"" May 21 20:21:50.195390 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.195365 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:50.200261 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.200234 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kwprk\"" May 21 20:21:50.209025 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.208994 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6rq8" May 21 20:21:50.242640 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.242605 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rt4bw\"" May 21 20:21:50.252501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.251102 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:50.261140 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.260821 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h49gp\"" May 21 20:21:50.269610 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.269174 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l9qfj" May 21 20:21:50.274189 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.274164 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m46lj\"" May 21 20:21:50.282197 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.282154 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" May 21 20:21:50.310689 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.310417 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4t59k\"" May 21 20:21:50.319974 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.319476 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2jxr" May 21 20:21:50.369169 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.369114 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgrgl"] May 21 20:21:50.386949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.385874 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6rq8"] May 21 20:21:50.490324 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.490289 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:21:50.517218 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.517187 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l9qfj"] May 21 20:21:50.521576 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:50.521534 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537c94a6_4e4f_4873_90b4_65e7e6a81b1a.slice/crio-7a5d0dabcee82a1f4a09698d4c69cd0c7b08b53de4e4fc084704e182766366d4 WatchSource:0}: Error finding container 7a5d0dabcee82a1f4a09698d4c69cd0c7b08b53de4e4fc084704e182766366d4: Status 404 returned error can't find the container with id 7a5d0dabcee82a1f4a09698d4c69cd0c7b08b53de4e4fc084704e182766366d4 May 21 20:21:50.528419 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.528383 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8"] May 21 20:21:50.561291 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.561262 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2jxr"] May 21 20:21:50.563742 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:21:50.563713 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4d1c8c_90db_4b15_bde6_5ab0489b4ba9.slice/crio-09b2ae98335d62f2542536885135fa46bcd7dc1a3015c527aa841521ae957ea4 WatchSource:0}: Error finding container 09b2ae98335d62f2542536885135fa46bcd7dc1a3015c527aa841521ae957ea4: Status 404 returned error can't find the container with id 09b2ae98335d62f2542536885135fa46bcd7dc1a3015c527aa841521ae957ea4 May 21 20:21:50.640462 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.640426 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" event={"ID":"e8173d9b-a8e1-4919-af0b-b926ee81148d","Type":"ContainerStarted","Data":"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420"} May 21 20:21:50.640462 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.640465 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" event={"ID":"e8173d9b-a8e1-4919-af0b-b926ee81148d","Type":"ContainerStarted","Data":"551eeefaa7d1ce0128693b105c8a2ff4691644342fcca55c499091fce70a6d42"} May 21 20:21:50.640731 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.640517 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:21:50.642057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.642023 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgrgl" event={"ID":"2a0d9808-d358-4c5a-91c9-668f8869d649","Type":"ContainerStarted","Data":"00ce002af96bec320eb006393a22ecf4a1ac47a49e6fef24155e6adb65da3e15"} May 21 20:21:50.642198 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.642067 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgrgl" event={"ID":"2a0d9808-d358-4c5a-91c9-668f8869d649","Type":"ContainerStarted","Data":"166cd4bf783a065e5f66f5baa642300b9e986dd08cdf0fb4956b50ca7b503160"} May 21 20:21:50.642198 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.642121 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:21:50.643153 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.643127 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6rq8" event={"ID":"71ba3135-325d-465a-ae56-7bb40941ebb2","Type":"ContainerStarted","Data":"8239abbaa165a3fbadd6beb77288cfefb304b14bb3e5b03cdd1f1386c05fbd2a"} May 21 20:21:50.644262 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.644241 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2jxr" event={"ID":"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9","Type":"ContainerStarted","Data":"09b2ae98335d62f2542536885135fa46bcd7dc1a3015c527aa841521ae957ea4"} May 21 20:21:50.645208 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.645189 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" event={"ID":"df68f186-06a9-4589-a97c-06ad9cc647c2","Type":"ContainerStarted","Data":"1cee5d1570742a1e0e9d4bcf36088c663d22cd29ec5190f55d13bc5c38d0cbc5"} May 21 20:21:50.648046 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.648017 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9qfj" event={"ID":"537c94a6-4e4f-4873-90b4-65e7e6a81b1a","Type":"ContainerStarted","Data":"7a5d0dabcee82a1f4a09698d4c69cd0c7b08b53de4e4fc084704e182766366d4"} May 21 20:21:50.659026 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.658977 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" podStartSLOduration=66.65896204 podStartE2EDuration="1m6.65896204s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:50.658813485 +0000 UTC m=+66.886760918" watchObservedRunningTime="2026-05-21 20:21:50.65896204 +0000 UTC m=+66.886909471" May 21 20:21:50.673156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:50.673100 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zgrgl" podStartSLOduration=66.67308302 podStartE2EDuration="1m6.67308302s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:50.672405543 +0000 UTC m=+66.900352975" watchObservedRunningTime="2026-05-21 20:21:50.67308302 +0000 UTC m=+66.901030479" May 21 20:21:53.657238 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.657198 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" event={"ID":"df68f186-06a9-4589-a97c-06ad9cc647c2","Type":"ContainerStarted","Data":"9dadcdcb8b3e373146a179d9c9f80e377a57215b6938b22262b6e759f59ec48b"} May 21 20:21:53.658825 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.658786 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9qfj" event={"ID":"537c94a6-4e4f-4873-90b4-65e7e6a81b1a","Type":"ContainerStarted","Data":"c06ae8feae4f501ae937c457b58a0b96a35279e742e2c2769ce525c8ef96fa3f"} May 21 20:21:53.658967 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.658831 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9qfj" event={"ID":"537c94a6-4e4f-4873-90b4-65e7e6a81b1a","Type":"ContainerStarted","Data":"b117c197b0cad7046dbdde19331de9ae23315237c1bddc94122122dbc63d4985"} May 21 20:21:53.658967 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.658897 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l9qfj" May 21 20:21:53.660232 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.660204 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6rq8" event={"ID":"71ba3135-325d-465a-ae56-7bb40941ebb2","Type":"ContainerStarted","Data":"d2b486412a16c28a412be37dac03700c5c6a1e68c45afc4729be3297b01e26c8"} May 21 20:21:53.660359 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.660238 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6rq8" event={"ID":"71ba3135-325d-465a-ae56-7bb40941ebb2","Type":"ContainerStarted","Data":"5da491b2f654089a1f37adad83f2f038d24503f966c31db5846c54d7447c458d"} May 21 20:21:53.661362 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.661340 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2jxr" event={"ID":"5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9","Type":"ContainerStarted","Data":"d57eb9e3b6667e9aedd175bff28c9b617f3821177cdbdcc399a834f9dcd071e0"} May 21 20:21:53.671789 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.671745 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-pp4q8" podStartSLOduration=39.401058774 podStartE2EDuration="41.671730625s" podCreationTimestamp="2026-05-21 20:21:12 +0000 UTC" firstStartedPulling="2026-05-21 20:21:50.534831875 +0000 UTC m=+66.762779284" lastFinishedPulling="2026-05-21 20:21:52.805503712 +0000 UTC m=+69.033451135" observedRunningTime="2026-05-21 20:21:53.670690315 +0000 UTC m=+69.898637750" watchObservedRunningTime="2026-05-21 20:21:53.671730625 +0000 UTC m=+69.899678056" May 21 20:21:53.684236 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.684174 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c6rq8" podStartSLOduration=67.276800261 podStartE2EDuration="1m9.684155988s" podCreationTimestamp="2026-05-21 20:20:44 +0000 UTC" firstStartedPulling="2026-05-21 20:21:50.397966213 +0000 UTC m=+66.625913637" lastFinishedPulling="2026-05-21 20:21:52.805321945 +0000 UTC m=+69.033269364" observedRunningTime="2026-05-21 20:21:53.683544325 +0000 UTC m=+69.911491763" watchObservedRunningTime="2026-05-21 20:21:53.684155988 +0000 UTC m=+69.912103419" May 21 20:21:53.699678 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.699629 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s2jxr" podStartSLOduration=33.457764037 podStartE2EDuration="35.699613879s" podCreationTimestamp="2026-05-21 20:21:18 +0000 UTC" firstStartedPulling="2026-05-21 20:21:50.565615262 +0000 UTC m=+66.793562672" lastFinishedPulling="2026-05-21 20:21:52.807465105 +0000 UTC m=+69.035412514" observedRunningTime="2026-05-21 20:21:53.698792018 +0000 UTC m=+69.926739452" watchObservedRunningTime="2026-05-21 20:21:53.699613879 +0000 UTC m=+69.927561310" May 21 20:21:53.714253 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:53.714188 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l9qfj" podStartSLOduration=33.428196993 podStartE2EDuration="35.714169029s" podCreationTimestamp="2026-05-21 20:21:18 +0000 UTC" firstStartedPulling="2026-05-21 20:21:50.523258392 +0000 UTC m=+66.751205819" lastFinishedPulling="2026-05-21 20:21:52.809230438 +0000 UTC m=+69.037177855" observedRunningTime="2026-05-21 20:21:53.712788726 +0000 UTC m=+69.940736159" watchObservedRunningTime="2026-05-21 20:21:53.714169029 +0000 UTC m=+69.942116462" May 21 20:21:54.222936 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:54.222893 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" podUID="158a2894-1b07-492a-8686-15e484b8c660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:21:57.716834 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:57.716696 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9qfj_537c94a6-4e4f-4873-90b4-65e7e6a81b1a/dns/0.log" May 21 20:21:57.903894 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:57.903866 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9qfj_537c94a6-4e4f-4873-90b4-65e7e6a81b1a/kube-rbac-proxy/0.log" May 21 20:21:58.503137 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:58.503109 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdbx6_4bd7604b-3c99-4a48-b36e-baf12a2dad78/dns-node-resolver/0.log" May 21 20:21:59.103228 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:59.103192 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-796f567b68-mrmvf_e8173d9b-a8e1-4919-af0b-b926ee81148d/registry/0.log" May 21 20:21:59.302802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:21:59.302773 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrxbs_9b04e2e4-9a63-46ba-99d3-abb3af641249/node-ca/0.log" May 21 20:22:00.302712 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:00.302684 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2jxr_5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9/serve-healthcheck-canary/0.log" May 21 20:22:03.183310 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.183274 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qspr6"] May 21 20:22:03.248777 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.248746 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.253361 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253323 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 20:22:03.253361 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253326 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 20:22:03.253616 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253374 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 20:22:03.253616 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253338 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 20:22:03.253616 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253487 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mdkbz\"" May 21 20:22:03.253973 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.253948 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 20:22:03.254097 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.254026 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 20:22:03.344914 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.344879 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.344935 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-textfile\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.344960 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.344980 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-metrics-client-ca\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.344997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-wtmp\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.345088 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345126 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.345121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjtz\" (UniqueName: \"kubernetes.io/projected/43efeebb-214b-4533-8b94-23ad6f98b4bb-kube-api-access-wcjtz\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345365 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.345151 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-sys\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.345365 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.345197 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-root\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.445822 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445726 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.445822 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445769 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-metrics-client-ca\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.445822 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445787 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-wtmp\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445828 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445871 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjtz\" (UniqueName: \"kubernetes.io/projected/43efeebb-214b-4533-8b94-23ad6f98b4bb-kube-api-access-wcjtz\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445897 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-sys\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445929 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-root\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445983 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-root\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.445994 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-sys\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:22:03.446012 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446012 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-wtmp\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:22:03.446083 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls podName:43efeebb-214b-4533-8b94-23ad6f98b4bb nodeName:}" failed. No retries permitted until 2026-05-21 20:22:03.946066756 +0000 UTC m=+80.174014167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls") pod "node-exporter-qspr6" (UID: "43efeebb-214b-4533-8b94-23ad6f98b4bb") : secret "node-exporter-tls" not found May 21 20:22:03.446106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446111 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446520 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-textfile\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446520 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446468 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-metrics-client-ca\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446520 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446473 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-textfile\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.446520 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.446468 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.448504 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.448481 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.456569 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.456540 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjtz\" (UniqueName: \"kubernetes.io/projected/43efeebb-214b-4533-8b94-23ad6f98b4bb-kube-api-access-wcjtz\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.668587 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.668556 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l9qfj" May 21 20:22:03.950156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.950109 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:03.952569 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:03.952534 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43efeebb-214b-4533-8b94-23ad6f98b4bb-node-exporter-tls\") pod \"node-exporter-qspr6\" (UID: \"43efeebb-214b-4533-8b94-23ad6f98b4bb\") " pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:04.162181 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.162149 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qspr6" May 21 20:22:04.170473 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:22:04.170445 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43efeebb_214b_4533_8b94_23ad6f98b4bb.slice/crio-fcb9912ea3a109e2665ea50bea333661829247d077242a449a0c58f228337207 WatchSource:0}: Error finding container fcb9912ea3a109e2665ea50bea333661829247d077242a449a0c58f228337207: Status 404 returned error can't find the container with id fcb9912ea3a109e2665ea50bea333661829247d077242a449a0c58f228337207 May 21 20:22:04.222506 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.222421 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" podUID="158a2894-1b07-492a-8686-15e484b8c660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:22:04.222506 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.222508 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" May 21 20:22:04.223042 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.223010 2551 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"37717761b1c91dd033368ac205cd8eecfd569149091424dfe321182a522e43ad"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 20:22:04.223116 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.223073 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" podUID="158a2894-1b07-492a-8686-15e484b8c660" containerName="service-proxy" containerID="cri-o://37717761b1c91dd033368ac205cd8eecfd569149091424dfe321182a522e43ad" gracePeriod=30 May 21 20:22:04.697105 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.697062 2551 generic.go:358] "Generic (PLEG): container finished" podID="158a2894-1b07-492a-8686-15e484b8c660" containerID="37717761b1c91dd033368ac205cd8eecfd569149091424dfe321182a522e43ad" exitCode=2 May 21 20:22:04.697306 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.697145 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerDied","Data":"37717761b1c91dd033368ac205cd8eecfd569149091424dfe321182a522e43ad"} May 21 20:22:04.697306 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.697194 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55d5d755d9-557mz" event={"ID":"158a2894-1b07-492a-8686-15e484b8c660","Type":"ContainerStarted","Data":"307c2734d305249489f743ea73158cc60f83e39df6572a4d14c673487ac96219"} May 21 20:22:04.698495 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:04.698464 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qspr6" event={"ID":"43efeebb-214b-4533-8b94-23ad6f98b4bb","Type":"ContainerStarted","Data":"fcb9912ea3a109e2665ea50bea333661829247d077242a449a0c58f228337207"} May 21 20:22:05.704019 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:05.703977 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qspr6" event={"ID":"43efeebb-214b-4533-8b94-23ad6f98b4bb","Type":"ContainerStarted","Data":"c6dc628635171930a37fd231b8f544fa3030e449055190736ca6203a6d7da81d"} May 21 20:22:06.394028 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.393992 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cnhtn"] May 21 20:22:06.413259 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.413228 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnhtn"] May 21 20:22:06.413410 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.413376 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.415747 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.415723 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 20:22:06.415928 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.415770 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 20:22:06.415928 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.415723 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 20:22:06.415928 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.415828 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 20:22:06.415928 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.415884 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pwfsr\"" May 21 20:22:06.573566 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.573526 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.573746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.573581 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74baaaa4-954d-4356-90ab-90ce7497ceb1-crio-socket\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.573746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.573657 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74baaaa4-954d-4356-90ab-90ce7497ceb1-data-volume\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.573746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.573693 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.573746 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.573716 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62jt6\" (UniqueName: \"kubernetes.io/projected/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-api-access-62jt6\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.674785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674699 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74baaaa4-954d-4356-90ab-90ce7497ceb1-crio-socket\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.674785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674744 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74baaaa4-954d-4356-90ab-90ce7497ceb1-data-volume\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.674785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674772 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.675049 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674800 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62jt6\" (UniqueName: \"kubernetes.io/projected/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-api-access-62jt6\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.675049 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674858 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74baaaa4-954d-4356-90ab-90ce7497ceb1-crio-socket\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.675049 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.674891 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.675049 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:22:06.674965 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 20:22:06.675049 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:22:06.675046 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls podName:74baaaa4-954d-4356-90ab-90ce7497ceb1 nodeName:}" failed. No retries permitted until 2026-05-21 20:22:07.175023808 +0000 UTC m=+83.402971218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnhtn" (UID: "74baaaa4-954d-4356-90ab-90ce7497ceb1") : secret "insights-runtime-extractor-tls" not found May 21 20:22:06.675287 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.675123 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74baaaa4-954d-4356-90ab-90ce7497ceb1-data-volume\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.675399 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.675382 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.683510 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.683476 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62jt6\" (UniqueName: \"kubernetes.io/projected/74baaaa4-954d-4356-90ab-90ce7497ceb1-kube-api-access-62jt6\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:06.708233 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.708204 2551 generic.go:358] "Generic (PLEG): container finished" podID="43efeebb-214b-4533-8b94-23ad6f98b4bb" containerID="c6dc628635171930a37fd231b8f544fa3030e449055190736ca6203a6d7da81d" exitCode=0 May 21 20:22:06.708652 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:06.708307 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qspr6" event={"ID":"43efeebb-214b-4533-8b94-23ad6f98b4bb","Type":"ContainerDied","Data":"c6dc628635171930a37fd231b8f544fa3030e449055190736ca6203a6d7da81d"} May 21 20:22:07.178597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.178549 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:07.181095 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.181071 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74baaaa4-954d-4356-90ab-90ce7497ceb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnhtn\" (UID: \"74baaaa4-954d-4356-90ab-90ce7497ceb1\") " pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:07.323999 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.323905 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnhtn" May 21 20:22:07.456703 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.456671 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnhtn"] May 21 20:22:07.459916 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:22:07.459889 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74baaaa4_954d_4356_90ab_90ce7497ceb1.slice/crio-29a8cba12c9ac6cdf97bdaa604793240119cb7619d10864b7367745b0802c7ac WatchSource:0}: Error finding container 29a8cba12c9ac6cdf97bdaa604793240119cb7619d10864b7367745b0802c7ac: Status 404 returned error can't find the container with id 29a8cba12c9ac6cdf97bdaa604793240119cb7619d10864b7367745b0802c7ac May 21 20:22:07.712447 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.712412 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnhtn" event={"ID":"74baaaa4-954d-4356-90ab-90ce7497ceb1","Type":"ContainerStarted","Data":"823dcefe9cbef1652e1909f130f0a2d08529a4b483f988fc5d209f61a2426a3a"} May 21 20:22:07.712872 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.712458 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnhtn" event={"ID":"74baaaa4-954d-4356-90ab-90ce7497ceb1","Type":"ContainerStarted","Data":"29a8cba12c9ac6cdf97bdaa604793240119cb7619d10864b7367745b0802c7ac"} May 21 20:22:07.714363 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.714334 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qspr6" event={"ID":"43efeebb-214b-4533-8b94-23ad6f98b4bb","Type":"ContainerStarted","Data":"568ee573f1cea3ba1f622e290c282ce26b53c7abedc8b517fbf6afbd8726bf8f"} May 21 20:22:07.714473 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.714369 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qspr6" event={"ID":"43efeebb-214b-4533-8b94-23ad6f98b4bb","Type":"ContainerStarted","Data":"0629085bf4dc13e289f43951932c1b7227fb58bceec3ed8523d30d228d5954bc"} May 21 20:22:07.732072 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:07.732017 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qspr6" podStartSLOduration=3.443000581 podStartE2EDuration="4.732000926s" podCreationTimestamp="2026-05-21 20:22:03 +0000 UTC" firstStartedPulling="2026-05-21 20:22:04.172419104 +0000 UTC m=+80.400366520" lastFinishedPulling="2026-05-21 20:22:05.461419449 +0000 UTC m=+81.689366865" observedRunningTime="2026-05-21 20:22:07.73059202 +0000 UTC m=+83.958539453" watchObservedRunningTime="2026-05-21 20:22:07.732000926 +0000 UTC m=+83.959948397" May 21 20:22:08.719747 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:08.719709 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnhtn" event={"ID":"74baaaa4-954d-4356-90ab-90ce7497ceb1","Type":"ContainerStarted","Data":"bd8bb09405e27a1fd14524deae811f06c803fb639120b3d32f9033f34eb3cb63"} May 21 20:22:10.726957 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:10.726836 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnhtn" event={"ID":"74baaaa4-954d-4356-90ab-90ce7497ceb1","Type":"ContainerStarted","Data":"728d86d530f2776b3d743e39e63a96af551c9fcb0bfb896a9b56be7bab524153"} May 21 20:22:10.745275 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:10.745221 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cnhtn" podStartSLOduration=1.977552222 podStartE2EDuration="4.745204187s" podCreationTimestamp="2026-05-21 20:22:06 +0000 UTC" firstStartedPulling="2026-05-21 20:22:07.596165336 +0000 UTC m=+83.824112747" lastFinishedPulling="2026-05-21 20:22:10.363817302 +0000 UTC m=+86.591764712" observedRunningTime="2026-05-21 20:22:10.74346949 +0000 UTC m=+86.971416923" watchObservedRunningTime="2026-05-21 20:22:10.745204187 +0000 UTC m=+86.973151642" May 21 20:22:11.656371 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:11.656332 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:22:11.919672 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:11.919576 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:22:21.654341 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:21.654309 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zgrgl" May 21 20:22:36.940757 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:36.940698 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" podUID="e8173d9b-a8e1-4919-af0b-b926ee81148d" containerName="registry" containerID="cri-o://a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420" gracePeriod=30 May 21 20:22:37.184520 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.184495 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:22:37.201682 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201620 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201682 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201664 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201694 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201748 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201767 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201784 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.201802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201799 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8vdc\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.202057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.201828 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") pod \"e8173d9b-a8e1-4919-af0b-b926ee81148d\" (UID: \"e8173d9b-a8e1-4919-af0b-b926ee81148d\") " May 21 20:22:37.203338 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.203300 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:22:37.203730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.202307 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:22:37.204264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.204167 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-trusted-ca\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.204264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.204191 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-certificates\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.205671 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.205155 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc" (OuterVolumeSpecName: "kube-api-access-g8vdc") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "kube-api-access-g8vdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:37.208110 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.208068 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:22:37.208434 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.208403 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:37.208516 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.208465 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:22:37.208693 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.208665 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:37.214318 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.214283 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e8173d9b-a8e1-4919-af0b-b926ee81148d" (UID: "e8173d9b-a8e1-4919-af0b-b926ee81148d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:22:37.305106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305068 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-bound-sa-token\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.305106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305102 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8vdc\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-kube-api-access-g8vdc\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.305106 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305112 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8173d9b-a8e1-4919-af0b-b926ee81148d-registry-tls\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.305327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305121 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-image-registry-private-configuration\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.305327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305131 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8173d9b-a8e1-4919-af0b-b926ee81148d-installation-pull-secrets\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.305327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.305142 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8173d9b-a8e1-4919-af0b-b926ee81148d-ca-trust-extracted\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:22:37.799379 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.799344 2551 generic.go:358] "Generic (PLEG): container finished" podID="e8173d9b-a8e1-4919-af0b-b926ee81148d" containerID="a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420" exitCode=0 May 21 20:22:37.799528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.799408 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" May 21 20:22:37.799528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.799429 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" event={"ID":"e8173d9b-a8e1-4919-af0b-b926ee81148d","Type":"ContainerDied","Data":"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420"} May 21 20:22:37.799528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.799462 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796f567b68-mrmvf" event={"ID":"e8173d9b-a8e1-4919-af0b-b926ee81148d","Type":"ContainerDied","Data":"551eeefaa7d1ce0128693b105c8a2ff4691644342fcca55c499091fce70a6d42"} May 21 20:22:37.799528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.799477 2551 scope.go:117] "RemoveContainer" containerID="a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420" May 21 20:22:37.808103 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.808083 2551 scope.go:117] "RemoveContainer" containerID="a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420" May 21 20:22:37.808410 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:22:37.808386 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420\": container with ID starting with a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420 not found: ID does not exist" containerID="a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420" May 21 20:22:37.808462 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.808424 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420"} err="failed to get container status \"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420\": rpc error: code = NotFound desc = could not find container \"a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420\": container with ID starting with a7cdab6509c020db16e5195235f501be8e2c6de088b25cea4c3af5179e5ac420 not found: ID does not exist" May 21 20:22:37.819686 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.819642 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:22:37.831437 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:37.831398 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-796f567b68-mrmvf"] May 21 20:22:38.376673 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:38.376632 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8173d9b-a8e1-4919-af0b-b926ee81148d" path="/var/lib/kubelet/pods/e8173d9b-a8e1-4919-af0b-b926ee81148d/volumes" May 21 20:22:55.848093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:55.848055 2551 generic.go:358] "Generic (PLEG): container finished" podID="050a54f2-c57b-4e92-b2dc-0527d0d1c6df" containerID="793921444bd5cf5c55a168bde111a50bdab53c073f064c13244563f1745ec10c" exitCode=0 May 21 20:22:55.848534 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:55.848122 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" event={"ID":"050a54f2-c57b-4e92-b2dc-0527d0d1c6df","Type":"ContainerDied","Data":"793921444bd5cf5c55a168bde111a50bdab53c073f064c13244563f1745ec10c"} May 21 20:22:55.848534 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:55.848453 2551 scope.go:117] "RemoveContainer" containerID="793921444bd5cf5c55a168bde111a50bdab53c073f064c13244563f1745ec10c" May 21 20:22:56.852521 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:22:56.852489 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c4rtp" event={"ID":"050a54f2-c57b-4e92-b2dc-0527d0d1c6df","Type":"ContainerStarted","Data":"9e71f9d89949bc61372408461c764c820e3865f50cf467903a6000d0f3c54d26"} May 21 20:25:44.280778 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:25:44.280753 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:25:44.283721 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:25:44.283698 2551 kubelet.go:1628] "Image garbage collection succeeded" May 21 20:25:44.284070 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:25:44.284057 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:26:55.396816 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.396781 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5"] May 21 20:26:55.397290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.397109 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8173d9b-a8e1-4919-af0b-b926ee81148d" containerName="registry" May 21 20:26:55.397290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.397122 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8173d9b-a8e1-4919-af0b-b926ee81148d" containerName="registry" May 21 20:26:55.397290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.397198 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8173d9b-a8e1-4919-af0b-b926ee81148d" containerName="registry" May 21 20:26:55.399994 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.399979 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.403677 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403650 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 20:26:55.403806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403650 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 20:26:55.403806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403739 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 20:26:55.403806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403781 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 20:26:55.403806 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403653 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rp8r4\"" May 21 20:26:55.404015 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.403784 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 20:26:55.408919 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.408900 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5"] May 21 20:26:55.492025 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.491993 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-metrics-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.492203 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.492102 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-manager-config\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.492203 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.492126 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz8r8\" (UniqueName: \"kubernetes.io/projected/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-kube-api-access-pz8r8\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.492203 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.492154 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.592586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.592555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-manager-config\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.592586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.592589 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pz8r8\" (UniqueName: \"kubernetes.io/projected/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-kube-api-access-pz8r8\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.592767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.592609 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.592767 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.592656 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-metrics-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.593394 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.593305 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-manager-config\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.595396 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.595373 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-metrics-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.595471 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.595373 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-cert\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.601360 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.601342 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz8r8\" (UniqueName: \"kubernetes.io/projected/e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c-kube-api-access-pz8r8\") pod \"lws-controller-manager-5999fcd7f9-7wmq5\" (UID: \"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c\") " pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.709324 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.709227 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:55.845753 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.845646 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5"] May 21 20:26:55.848394 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:26:55.848369 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode293ee73_1dbe_44a6_a62b_d8d94cb6ba9c.slice/crio-3326752e305b141517e0eaa03592f1f1295a97b3718c6facbe4e124403179cb2 WatchSource:0}: Error finding container 3326752e305b141517e0eaa03592f1f1295a97b3718c6facbe4e124403179cb2: Status 404 returned error can't find the container with id 3326752e305b141517e0eaa03592f1f1295a97b3718c6facbe4e124403179cb2 May 21 20:26:55.850137 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:55.850125 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:26:56.484626 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:56.484586 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" event={"ID":"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c","Type":"ContainerStarted","Data":"3326752e305b141517e0eaa03592f1f1295a97b3718c6facbe4e124403179cb2"} May 21 20:26:58.490957 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:58.490912 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" event={"ID":"e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c","Type":"ContainerStarted","Data":"1e04312b1f3e2cdedcc2ad2043f94cde0c25124eda40e91fb0279e78a60bd5f6"} May 21 20:26:58.491340 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:58.490975 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:26:58.510264 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:26:58.510162 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" podStartSLOduration=1.102691774 podStartE2EDuration="3.510146504s" podCreationTimestamp="2026-05-21 20:26:55 +0000 UTC" firstStartedPulling="2026-05-21 20:26:55.85026138 +0000 UTC m=+372.078208790" lastFinishedPulling="2026-05-21 20:26:58.257716101 +0000 UTC m=+374.485663520" observedRunningTime="2026-05-21 20:26:58.50833409 +0000 UTC m=+374.736281528" watchObservedRunningTime="2026-05-21 20:26:58.510146504 +0000 UTC m=+374.738093935" May 21 20:27:06.257128 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.257090 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp"] May 21 20:27:06.260595 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.260576 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.263892 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.263873 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 20:27:06.264011 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.263963 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 20:27:06.264078 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.264032 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7tnw8\"" May 21 20:27:06.264129 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.264080 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 20:27:06.264129 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.264117 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 20:27:06.280760 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.280731 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp"] May 21 20:27:06.372944 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.372906 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.373127 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.373042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l8nd\" (UniqueName: \"kubernetes.io/projected/b897ea9a-4150-498f-a770-f8c4303f9967-kube-api-access-5l8nd\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.373127 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.373092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.474439 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.474393 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5l8nd\" (UniqueName: \"kubernetes.io/projected/b897ea9a-4150-498f-a770-f8c4303f9967-kube-api-access-5l8nd\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.474439 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.474438 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.474656 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.474587 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.477118 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.477093 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.477221 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.477126 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b897ea9a-4150-498f-a770-f8c4303f9967-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.483473 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.483453 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l8nd\" (UniqueName: \"kubernetes.io/projected/b897ea9a-4150-498f-a770-f8c4303f9967-kube-api-access-5l8nd\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-pqllp\" (UID: \"b897ea9a-4150-498f-a770-f8c4303f9967\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.570632 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.570550 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:06.724693 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:06.724655 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp"] May 21 20:27:06.727657 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:27:06.727625 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb897ea9a_4150_498f_a770_f8c4303f9967.slice/crio-0509f710d7985ae9340cf45deb950a7b048425f1877f4b5b00c08a575db4fbf8 WatchSource:0}: Error finding container 0509f710d7985ae9340cf45deb950a7b048425f1877f4b5b00c08a575db4fbf8: Status 404 returned error can't find the container with id 0509f710d7985ae9340cf45deb950a7b048425f1877f4b5b00c08a575db4fbf8 May 21 20:27:07.518917 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:07.518881 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" event={"ID":"b897ea9a-4150-498f-a770-f8c4303f9967","Type":"ContainerStarted","Data":"0509f710d7985ae9340cf45deb950a7b048425f1877f4b5b00c08a575db4fbf8"} May 21 20:27:09.499112 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:09.499078 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5999fcd7f9-7wmq5" May 21 20:27:10.529435 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:10.529394 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" event={"ID":"b897ea9a-4150-498f-a770-f8c4303f9967","Type":"ContainerStarted","Data":"42a59a9cdf5da8495280f4fb77d0002325487d96ad550be9471b3640d3dee060"} May 21 20:27:10.529921 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:10.529564 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:10.554298 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:10.554244 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" podStartSLOduration=1.777817342 podStartE2EDuration="4.554230735s" podCreationTimestamp="2026-05-21 20:27:06 +0000 UTC" firstStartedPulling="2026-05-21 20:27:06.729294976 +0000 UTC m=+382.957242386" lastFinishedPulling="2026-05-21 20:27:09.50570837 +0000 UTC m=+385.733655779" observedRunningTime="2026-05-21 20:27:10.552717839 +0000 UTC m=+386.780665272" watchObservedRunningTime="2026-05-21 20:27:10.554230735 +0000 UTC m=+386.782178167" May 21 20:27:21.535488 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:21.535456 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-pqllp" May 21 20:27:48.956211 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.956175 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:27:48.964955 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.964927 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:48.967621 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.967590 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 20:27:48.967768 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.967662 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hjlqk\"" May 21 20:27:48.967768 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.967669 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 20:27:48.968001 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.967986 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 20:27:48.976107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:48.976082 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:27:49.088713 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.088673 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr"] May 21 20:27:49.091670 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.091652 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.102068 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.102040 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr"] May 21 20:27:49.103486 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103460 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103611 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103611 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103611 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67qn\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103794 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103612 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103794 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103643 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103794 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103794 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103717 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.103794 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.103778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205044 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205003 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205044 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205046 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205077 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205108 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205140 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205164 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205187 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205237 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205291 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205329 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205372 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205403 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e78d180-49eb-4c12-b937-606afce16ab7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205432 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxbf\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-kube-api-access-7xxbf\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205465 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205494 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205527 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e78d180-49eb-4c12-b937-606afce16ab7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.205992 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205617 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w67qn\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205992 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205648 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205992 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205710 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205992 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205940 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.205992 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.205940 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.206165 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.206144 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.207720 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.207681 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.207950 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.207929 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.218542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.218513 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.218684 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.218574 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67qn\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.275740 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.275702 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:49.307152 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307103 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307163 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307206 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e78d180-49eb-4c12-b937-606afce16ab7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307255 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307297 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307321 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307583 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307351 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307583 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307440 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e78d180-49eb-4c12-b937-606afce16ab7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307583 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307467 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxbf\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-kube-api-access-7xxbf\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307583 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307527 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307780 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307594 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307780 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307703 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.307780 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.307774 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.308255 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.308187 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e78d180-49eb-4c12-b937-606afce16ab7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.309799 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.309775 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e78d180-49eb-4c12-b937-606afce16ab7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.309952 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.309934 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e78d180-49eb-4c12-b937-606afce16ab7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.317830 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.317799 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.317994 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.317826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxbf\" (UniqueName: \"kubernetes.io/projected/6e78d180-49eb-4c12-b937-606afce16ab7-kube-api-access-7xxbf\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr\" (UID: \"6e78d180-49eb-4c12-b937-606afce16ab7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.402522 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.402490 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:49.413919 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.413828 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:27:49.417099 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:27:49.417061 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7401f7_7259_442d_b0ac_140136f75c4e.slice/crio-ee2ca773ea775238fc781fb6e410a75aeba1a91b585d448b27a20c6de86eea81 WatchSource:0}: Error finding container ee2ca773ea775238fc781fb6e410a75aeba1a91b585d448b27a20c6de86eea81: Status 404 returned error can't find the container with id ee2ca773ea775238fc781fb6e410a75aeba1a91b585d448b27a20c6de86eea81 May 21 20:27:49.538592 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.538556 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr"] May 21 20:27:49.541768 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:27:49.541740 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e78d180_49eb_4c12_b937_606afce16ab7.slice/crio-b1f2cb965fdb7d4540f20bb8ce0206555f85e24149db8ba509e51bd1a0a08726 WatchSource:0}: Error finding container b1f2cb965fdb7d4540f20bb8ce0206555f85e24149db8ba509e51bd1a0a08726: Status 404 returned error can't find the container with id b1f2cb965fdb7d4540f20bb8ce0206555f85e24149db8ba509e51bd1a0a08726 May 21 20:27:49.635475 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.635426 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" event={"ID":"6b7401f7-7259-442d-b0ac-140136f75c4e","Type":"ContainerStarted","Data":"ee2ca773ea775238fc781fb6e410a75aeba1a91b585d448b27a20c6de86eea81"} May 21 20:27:49.636412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:49.636388 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" event={"ID":"6e78d180-49eb-4c12-b937-606afce16ab7","Type":"ContainerStarted","Data":"b1f2cb965fdb7d4540f20bb8ce0206555f85e24149db8ba509e51bd1a0a08726"} May 21 20:27:52.046588 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.046538 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.046822 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.046632 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.046822 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.046659 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.599285 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.599244 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.599414 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.599319 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.599414 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.599349 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:52.647028 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.646997 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" event={"ID":"6e78d180-49eb-4c12-b937-606afce16ab7","Type":"ContainerStarted","Data":"031b4219e952d22b633ed8eb866d71ae4fd59017709cde1727af7e9bc9721263"} May 21 20:27:52.669197 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:52.669144 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" podStartSLOduration=1.168485987 podStartE2EDuration="3.669126478s" podCreationTimestamp="2026-05-21 20:27:49 +0000 UTC" firstStartedPulling="2026-05-21 20:27:49.545650224 +0000 UTC m=+425.773597633" lastFinishedPulling="2026-05-21 20:27:52.046290704 +0000 UTC m=+428.274238124" observedRunningTime="2026-05-21 20:27:52.667961144 +0000 UTC m=+428.895908576" watchObservedRunningTime="2026-05-21 20:27:52.669126478 +0000 UTC m=+428.897073910" May 21 20:27:53.403664 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.403620 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:53.408344 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.408319 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:53.650482 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.650440 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" event={"ID":"6b7401f7-7259-442d-b0ac-140136f75c4e","Type":"ContainerStarted","Data":"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e"} May 21 20:27:53.650664 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.650650 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:53.651771 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.651752 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr" May 21 20:27:53.671558 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.671457 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" podStartSLOduration=2.491326739 podStartE2EDuration="5.67144211s" podCreationTimestamp="2026-05-21 20:27:48 +0000 UTC" firstStartedPulling="2026-05-21 20:27:49.418892208 +0000 UTC m=+425.646839626" lastFinishedPulling="2026-05-21 20:27:52.599007579 +0000 UTC m=+428.826954997" observedRunningTime="2026-05-21 20:27:53.670776168 +0000 UTC m=+429.898723601" watchObservedRunningTime="2026-05-21 20:27:53.67144211 +0000 UTC m=+429.899389534" May 21 20:27:53.717356 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:53.717311 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:27:54.276603 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:54.276566 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:27:54.277883 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:54.277837 2551 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= May 21 20:27:54.277996 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:54.277936 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" May 21 20:27:55.277096 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:55.277056 2551 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= May 21 20:27:55.277465 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:55.277125 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" May 21 20:27:55.656192 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:27:55.656143 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" containerID="cri-o://5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e" gracePeriod=30 May 21 20:28:00.902448 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:00.902417 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:28:01.005326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005234 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005292 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005316 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005361 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005381 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005400 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005426 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005452 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w67qn\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005480 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs\") pod \"6b7401f7-7259-442d-b0ac-140136f75c4e\" (UID: \"6b7401f7-7259-442d-b0ac-140136f75c4e\") " May 21 20:28:01.005882 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005654 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:01.005984 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005959 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:01.006040 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.006009 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:28:01.006145 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.005981 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:01.006282 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.006084 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:01.007783 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.007757 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:01.007783 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.007767 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" May 21 20:28:01.007926 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.007799 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:01.008157 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.008141 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn" (OuterVolumeSpecName: "kube-api-access-w67qn") pod "6b7401f7-7259-442d-b0ac-140136f75c4e" (UID: "6b7401f7-7259-442d-b0ac-140136f75c4e"). InnerVolumeSpecName "kube-api-access-w67qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:01.106913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106880 2551 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-podinfo\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.106913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106907 2551 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b7401f7-7259-442d-b0ac-140136f75c4e-istiod-ca-cert\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.106913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106916 2551 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-data\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.106913 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106924 2551 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-socket\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.107177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106932 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w67qn\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-kube-api-access-w67qn\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.107177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106942 2551 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-workload-certs\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.107177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106950 2551 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-token\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.107177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106958 2551 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-credential-socket\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.107177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.106966 2551 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b7401f7-7259-442d-b0ac-140136f75c4e-istio-envoy\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:28:01.674569 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.674533 2551 generic.go:358] "Generic (PLEG): container finished" podID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerID="5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e" exitCode=0 May 21 20:28:01.674749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.674592 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" event={"ID":"6b7401f7-7259-442d-b0ac-140136f75c4e","Type":"ContainerDied","Data":"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e"} May 21 20:28:01.674749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.674600 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" May 21 20:28:01.674749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.674621 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj" event={"ID":"6b7401f7-7259-442d-b0ac-140136f75c4e","Type":"ContainerDied","Data":"ee2ca773ea775238fc781fb6e410a75aeba1a91b585d448b27a20c6de86eea81"} May 21 20:28:01.674749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.674636 2551 scope.go:117] "RemoveContainer" containerID="5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e" May 21 20:28:01.686364 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.686342 2551 scope.go:117] "RemoveContainer" containerID="5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e" May 21 20:28:01.686698 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:28:01.686677 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e\": container with ID starting with 5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e not found: ID does not exist" containerID="5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e" May 21 20:28:01.686755 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.686707 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e"} err="failed to get container status \"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e\": rpc error: code = NotFound desc = could not find container \"5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e\": container with ID starting with 5a74c12fb24fd5e6a613149bdbce27aeb0f79855a53a9ea44a81dc3e39efb59e not found: ID does not exist" May 21 20:28:01.696671 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.696637 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:28:01.700570 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:01.700546 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44xwrgj"] May 21 20:28:02.376603 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:02.376566 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" path="/var/lib/kubelet/pods/6b7401f7-7259-442d-b0ac-140136f75c4e/volumes" May 21 20:28:24.930304 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.930268 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk79f"] May 21 20:28:24.930717 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.930530 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" May 21 20:28:24.930717 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.930541 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" May 21 20:28:24.930717 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.930581 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b7401f7-7259-442d-b0ac-140136f75c4e" containerName="istio-proxy" May 21 20:28:24.934840 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.934823 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:24.937326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.937294 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-c4n5z\"" May 21 20:28:24.937326 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.937300 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:28:24.938090 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.938073 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:28:24.942775 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:24.942750 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk79f"] May 21 20:28:25.085098 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.085052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2qt\" (UniqueName: \"kubernetes.io/projected/1d80df1f-a3bd-4a4b-8278-5f801c8e8e54-kube-api-access-sf2qt\") pod \"kuadrant-operator-catalog-dk79f\" (UID: \"1d80df1f-a3bd-4a4b-8278-5f801c8e8e54\") " pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:25.186476 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.186367 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2qt\" (UniqueName: \"kubernetes.io/projected/1d80df1f-a3bd-4a4b-8278-5f801c8e8e54-kube-api-access-sf2qt\") pod \"kuadrant-operator-catalog-dk79f\" (UID: \"1d80df1f-a3bd-4a4b-8278-5f801c8e8e54\") " pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:25.195622 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.195597 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2qt\" (UniqueName: \"kubernetes.io/projected/1d80df1f-a3bd-4a4b-8278-5f801c8e8e54-kube-api-access-sf2qt\") pod \"kuadrant-operator-catalog-dk79f\" (UID: \"1d80df1f-a3bd-4a4b-8278-5f801c8e8e54\") " pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:25.244577 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.244532 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:25.376024 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.375940 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk79f"] May 21 20:28:25.378407 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:28:25.378365 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d80df1f_a3bd_4a4b_8278_5f801c8e8e54.slice/crio-0a942b38dac2d5d0f7c2695e23d4ec74ad67d7c74520a0d340fb858f7e5fbe6f WatchSource:0}: Error finding container 0a942b38dac2d5d0f7c2695e23d4ec74ad67d7c74520a0d340fb858f7e5fbe6f: Status 404 returned error can't find the container with id 0a942b38dac2d5d0f7c2695e23d4ec74ad67d7c74520a0d340fb858f7e5fbe6f May 21 20:28:25.743466 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:25.743432 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" event={"ID":"1d80df1f-a3bd-4a4b-8278-5f801c8e8e54","Type":"ContainerStarted","Data":"0a942b38dac2d5d0f7c2695e23d4ec74ad67d7c74520a0d340fb858f7e5fbe6f"} May 21 20:28:28.754574 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:28.754532 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" event={"ID":"1d80df1f-a3bd-4a4b-8278-5f801c8e8e54","Type":"ContainerStarted","Data":"298f1be8f6c9138e948cc3384c788a7e19091d4bd84eae44b20f5eee72759179"} May 21 20:28:28.771355 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:28.771299 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" podStartSLOduration=2.419810011 podStartE2EDuration="4.771282171s" podCreationTimestamp="2026-05-21 20:28:24 +0000 UTC" firstStartedPulling="2026-05-21 20:28:25.379836279 +0000 UTC m=+461.607783696" lastFinishedPulling="2026-05-21 20:28:27.731308446 +0000 UTC m=+463.959255856" observedRunningTime="2026-05-21 20:28:28.770151263 +0000 UTC m=+464.998098695" watchObservedRunningTime="2026-05-21 20:28:28.771282171 +0000 UTC m=+464.999229603" May 21 20:28:35.245433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:35.245391 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:35.245433 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:35.245442 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:35.267635 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:35.267611 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:35.795778 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:35.795748 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dk79f" May 21 20:28:56.878351 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.878315 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d"] May 21 20:28:56.884955 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.884926 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:56.890513 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.890487 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggdlz\"" May 21 20:28:56.902564 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.902519 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:56.902763 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.902635 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4wg\" (UniqueName: \"kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:56.903643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:56.903614 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d"] May 21 20:28:57.003151 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.003110 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:57.003333 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.003183 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4wg\" (UniqueName: \"kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:57.003459 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.003434 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:57.014916 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.014880 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4wg\" (UniqueName: \"kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:57.195502 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.195378 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:28:57.335298 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.335257 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d"] May 21 20:28:57.339654 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:28:57.339607 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad7dee4_9de8_4c2c_aaea_900ab5bd71bf.slice/crio-664f1534216d6765e5fb2ce59aac02745e4b5064fc802cd060a07600b493ba60 WatchSource:0}: Error finding container 664f1534216d6765e5fb2ce59aac02745e4b5064fc802cd060a07600b493ba60: Status 404 returned error can't find the container with id 664f1534216d6765e5fb2ce59aac02745e4b5064fc802cd060a07600b493ba60 May 21 20:28:57.838347 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:28:57.838313 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" event={"ID":"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf","Type":"ContainerStarted","Data":"664f1534216d6765e5fb2ce59aac02745e4b5064fc802cd060a07600b493ba60"} May 21 20:29:01.689716 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.689675 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7"] May 21 20:29:01.693376 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.693352 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:01.695834 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.695804 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 20:29:01.696022 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.695805 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zsqbd\"" May 21 20:29:01.702243 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.702215 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7"] May 21 20:29:01.735262 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.735218 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4nms\" (UniqueName: \"kubernetes.io/projected/b1c7960b-b934-4cf0-aca9-7d3fe71b0768-kube-api-access-m4nms\") pod \"dns-operator-controller-manager-648d5c98bc-ghlt7\" (UID: \"b1c7960b-b934-4cf0-aca9-7d3fe71b0768\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:01.836516 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.836484 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4nms\" (UniqueName: \"kubernetes.io/projected/b1c7960b-b934-4cf0-aca9-7d3fe71b0768-kube-api-access-m4nms\") pod \"dns-operator-controller-manager-648d5c98bc-ghlt7\" (UID: \"b1c7960b-b934-4cf0-aca9-7d3fe71b0768\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:01.845987 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:01.845963 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4nms\" (UniqueName: \"kubernetes.io/projected/b1c7960b-b934-4cf0-aca9-7d3fe71b0768-kube-api-access-m4nms\") pod \"dns-operator-controller-manager-648d5c98bc-ghlt7\" (UID: \"b1c7960b-b934-4cf0-aca9-7d3fe71b0768\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:02.007010 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.006969 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:02.153892 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.153800 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7"] May 21 20:29:02.156112 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:29:02.156082 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c7960b_b934_4cf0_aca9_7d3fe71b0768.slice/crio-22de68852257e5d6f1eb60ceaf5ef76170f8bd1a060851e1b97959ecfe8f4608 WatchSource:0}: Error finding container 22de68852257e5d6f1eb60ceaf5ef76170f8bd1a060851e1b97959ecfe8f4608: Status 404 returned error can't find the container with id 22de68852257e5d6f1eb60ceaf5ef76170f8bd1a060851e1b97959ecfe8f4608 May 21 20:29:02.855612 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.855569 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" event={"ID":"b1c7960b-b934-4cf0-aca9-7d3fe71b0768","Type":"ContainerStarted","Data":"22de68852257e5d6f1eb60ceaf5ef76170f8bd1a060851e1b97959ecfe8f4608"} May 21 20:29:02.856968 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.856944 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" event={"ID":"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf","Type":"ContainerStarted","Data":"a1d414a7f5619d1920418f1de151f12186f15f6405c10eda6ed55ebaf893fd92"} May 21 20:29:02.857111 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.857096 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:29:02.879378 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:02.879318 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" podStartSLOduration=2.309961717 podStartE2EDuration="6.87929845s" podCreationTimestamp="2026-05-21 20:28:56 +0000 UTC" firstStartedPulling="2026-05-21 20:28:57.342078779 +0000 UTC m=+493.570026189" lastFinishedPulling="2026-05-21 20:29:01.91141551 +0000 UTC m=+498.139362922" observedRunningTime="2026-05-21 20:29:02.877241857 +0000 UTC m=+499.105189289" watchObservedRunningTime="2026-05-21 20:29:02.87929845 +0000 UTC m=+499.107245882" May 21 20:29:03.765615 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.765577 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj"] May 21 20:29:03.768732 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.768712 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:03.771262 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.771236 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gkr46\"" May 21 20:29:03.778971 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.778941 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj"] May 21 20:29:03.849290 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.849240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5c69\" (UniqueName: \"kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69\") pod \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" (UID: \"0fdb7ea4-d7dd-4242-8fba-4a063716b106\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:03.950263 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.950224 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c69\" (UniqueName: \"kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69\") pod \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" (UID: \"0fdb7ea4-d7dd-4242-8fba-4a063716b106\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:03.966107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:03.966077 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5c69\" (UniqueName: \"kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69\") pod \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" (UID: \"0fdb7ea4-d7dd-4242-8fba-4a063716b106\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:04.080176 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.080089 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:04.425430 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.425272 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj"] May 21 20:29:04.428254 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:29:04.428202 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdb7ea4_d7dd_4242_8fba_4a063716b106.slice/crio-a81cceacac8a1d86948cadaca7081f6aa86c228d947e1147b0bb7385c7114af3 WatchSource:0}: Error finding container a81cceacac8a1d86948cadaca7081f6aa86c228d947e1147b0bb7385c7114af3: Status 404 returned error can't find the container with id a81cceacac8a1d86948cadaca7081f6aa86c228d947e1147b0bb7385c7114af3 May 21 20:29:04.864574 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.864541 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" event={"ID":"b1c7960b-b934-4cf0-aca9-7d3fe71b0768","Type":"ContainerStarted","Data":"473af5d2c9361ddcef66a841e022b1a22739045248f263d418ab44fbd2807e4d"} May 21 20:29:04.864789 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.864644 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:04.865663 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.865639 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" event={"ID":"0fdb7ea4-d7dd-4242-8fba-4a063716b106","Type":"ContainerStarted","Data":"a81cceacac8a1d86948cadaca7081f6aa86c228d947e1147b0bb7385c7114af3"} May 21 20:29:04.885939 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:04.885890 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" podStartSLOduration=1.706399943 podStartE2EDuration="3.885873972s" podCreationTimestamp="2026-05-21 20:29:01 +0000 UTC" firstStartedPulling="2026-05-21 20:29:02.158013554 +0000 UTC m=+498.385960964" lastFinishedPulling="2026-05-21 20:29:04.337487565 +0000 UTC m=+500.565434993" observedRunningTime="2026-05-21 20:29:04.884598371 +0000 UTC m=+501.112545803" watchObservedRunningTime="2026-05-21 20:29:04.885873972 +0000 UTC m=+501.113821404" May 21 20:29:05.133086 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.132992 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr"] May 21 20:29:05.136526 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.136502 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.139085 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.139061 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgdrv\"" May 21 20:29:05.139581 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.139558 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 20:29:05.139685 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.139561 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 20:29:05.145132 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.144944 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr"] May 21 20:29:05.160832 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.160792 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpnh\" (UniqueName: \"kubernetes.io/projected/9224dd7a-f720-4854-b29c-6df38856b07e-kube-api-access-mbpnh\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.161018 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.160882 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9224dd7a-f720-4854-b29c-6df38856b07e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.161018 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.160931 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9224dd7a-f720-4854-b29c-6df38856b07e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.261963 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.261913 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpnh\" (UniqueName: \"kubernetes.io/projected/9224dd7a-f720-4854-b29c-6df38856b07e-kube-api-access-mbpnh\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.262150 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.261970 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9224dd7a-f720-4854-b29c-6df38856b07e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.262150 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.262021 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9224dd7a-f720-4854-b29c-6df38856b07e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.262763 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.262736 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9224dd7a-f720-4854-b29c-6df38856b07e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.265603 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.265575 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9224dd7a-f720-4854-b29c-6df38856b07e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.270656 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.270633 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpnh\" (UniqueName: \"kubernetes.io/projected/9224dd7a-f720-4854-b29c-6df38856b07e-kube-api-access-mbpnh\") pod \"kuadrant-console-plugin-6cb54b5c86-m4fsr\" (UID: \"9224dd7a-f720-4854-b29c-6df38856b07e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.447891 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.447787 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" May 21 20:29:05.586508 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.586478 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr"] May 21 20:29:05.589570 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:29:05.589538 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9224dd7a_f720_4854_b29c_6df38856b07e.slice/crio-f64509c2e5ed3f951325481a3b0c12ff3329ae4c3c4b74862b3c9d6cf80a5ad1 WatchSource:0}: Error finding container f64509c2e5ed3f951325481a3b0c12ff3329ae4c3c4b74862b3c9d6cf80a5ad1: Status 404 returned error can't find the container with id f64509c2e5ed3f951325481a3b0c12ff3329ae4c3c4b74862b3c9d6cf80a5ad1 May 21 20:29:05.871585 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:05.871536 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" event={"ID":"9224dd7a-f720-4854-b29c-6df38856b07e","Type":"ContainerStarted","Data":"f64509c2e5ed3f951325481a3b0c12ff3329ae4c3c4b74862b3c9d6cf80a5ad1"} May 21 20:29:06.877813 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:06.877769 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" event={"ID":"0fdb7ea4-d7dd-4242-8fba-4a063716b106","Type":"ContainerStarted","Data":"a8eeec56ad44f3aff3b027f7636c90e7b403637088d795efa5e438f7a013893e"} May 21 20:29:06.878312 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:06.877910 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:06.897672 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:06.897391 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" podStartSLOduration=2.118456542 podStartE2EDuration="3.897371187s" podCreationTimestamp="2026-05-21 20:29:03 +0000 UTC" firstStartedPulling="2026-05-21 20:29:04.430531856 +0000 UTC m=+500.658479275" lastFinishedPulling="2026-05-21 20:29:06.209446507 +0000 UTC m=+502.437393920" observedRunningTime="2026-05-21 20:29:06.896071501 +0000 UTC m=+503.124018934" watchObservedRunningTime="2026-05-21 20:29:06.897371187 +0000 UTC m=+503.125318620" May 21 20:29:13.863319 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:13.863278 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:29:15.581421 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.581377 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d"] May 21 20:29:15.581890 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.581719 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" containerName="manager" containerID="cri-o://a1d414a7f5619d1920418f1de151f12186f15f6405c10eda6ed55ebaf893fd92" gracePeriod=2 May 21 20:29:15.588341 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.588270 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d"] May 21 20:29:15.600989 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.600939 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj"] May 21 20:29:15.601388 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.601323 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" containerName="manager" containerID="cri-o://a8eeec56ad44f3aff3b027f7636c90e7b403637088d795efa5e438f7a013893e" gracePeriod=2 May 21 20:29:15.603654 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.603614 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:15.604002 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.603969 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.618663 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.618445 2551 status_manager.go:895] "Failed to get status for pod" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" err="pods \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.619677 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.619645 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj"] May 21 20:29:15.620707 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.620663 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.665552 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.665502 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx"] May 21 20:29:15.665934 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.665910 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" containerName="manager" May 21 20:29:15.666057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.665934 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" containerName="manager" May 21 20:29:15.666057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.665960 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" containerName="manager" May 21 20:29:15.666057 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.665970 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" containerName="manager" May 21 20:29:15.666220 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.666087 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" containerName="manager" May 21 20:29:15.666220 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.666099 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" containerName="manager" May 21 20:29:15.669210 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.669184 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:15.675118 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.675078 2551 status_manager.go:895] "Failed to get status for pod" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" err="pods \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.677406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.677376 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.681058 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.681026 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx"] May 21 20:29:15.744443 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.744403 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwt2w\" (UniqueName: \"kubernetes.io/projected/1626f50d-01fd-4b29-bac2-d8ffd354a796-kube-api-access-mwt2w\") pod \"limitador-operator-controller-manager-85c4996f8c-msjtx\" (UID: \"1626f50d-01fd-4b29-bac2-d8ffd354a796\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:15.845037 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.844986 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt2w\" (UniqueName: \"kubernetes.io/projected/1626f50d-01fd-4b29-bac2-d8ffd354a796-kube-api-access-mwt2w\") pod \"limitador-operator-controller-manager-85c4996f8c-msjtx\" (UID: \"1626f50d-01fd-4b29-bac2-d8ffd354a796\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:15.854862 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.854805 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt2w\" (UniqueName: \"kubernetes.io/projected/1626f50d-01fd-4b29-bac2-d8ffd354a796-kube-api-access-mwt2w\") pod \"limitador-operator-controller-manager-85c4996f8c-msjtx\" (UID: \"1626f50d-01fd-4b29-bac2-d8ffd354a796\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:15.875044 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.875007 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ghlt7" May 21 20:29:15.877287 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.877235 2551 status_manager.go:895] "Failed to get status for pod" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" err="pods \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:15.879388 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:15.879345 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:16.020968 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.020907 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:16.906112 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.906070 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:29:16.929586 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.929541 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:16.929749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.929549 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:29:16.955787 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.955751 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s799z\" (UniqueName: \"kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:16.955948 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:16.955803 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:17.057125 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:17.057085 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s799z\" (UniqueName: \"kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:17.057329 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:17.057148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:17.057528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:17.057507 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:17.077509 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:17.077476 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s799z\" (UniqueName: \"kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kd6sb\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:17.244428 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:17.244322 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:27.954791 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:27.954669 2551 generic.go:358] "Generic (PLEG): container finished" podID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" containerID="a1d414a7f5619d1920418f1de151f12186f15f6405c10eda6ed55ebaf893fd92" exitCode=0 May 21 20:29:27.958024 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:27.957825 2551 generic.go:358] "Generic (PLEG): container finished" podID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" containerID="a8eeec56ad44f3aff3b027f7636c90e7b403637088d795efa5e438f7a013893e" exitCode=0 May 21 20:29:28.089716 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.089681 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx"] May 21 20:29:28.098131 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:29:28.098093 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1626f50d_01fd_4b29_bac2_d8ffd354a796.slice/crio-1b9cceb27338d2a1a14345cd755764e07f6b6311d087d6009ac933cc08b938e5 WatchSource:0}: Error finding container 1b9cceb27338d2a1a14345cd755764e07f6b6311d087d6009ac933cc08b938e5: Status 404 returned error can't find the container with id 1b9cceb27338d2a1a14345cd755764e07f6b6311d087d6009ac933cc08b938e5 May 21 20:29:28.099911 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.099888 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:29:28.102299 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.102275 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:28.103689 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.103669 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:28.105603 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.105576 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:28.107452 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.107425 2551 status_manager.go:895] "Failed to get status for pod" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" err="pods \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:28.115028 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.115000 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:29:28.118649 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:29:28.117958 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb824c48_0352_4943_8ef8_58ccf03056e8.slice/crio-fa7fbf647ccc42eeb0ad3a1188decdc2014d016483e2ec72215257af3b60dd12 WatchSource:0}: Error finding container fa7fbf647ccc42eeb0ad3a1188decdc2014d016483e2ec72215257af3b60dd12: Status 404 returned error can't find the container with id fa7fbf647ccc42eeb0ad3a1188decdc2014d016483e2ec72215257af3b60dd12 May 21 20:29:28.157928 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.157906 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5c69\" (UniqueName: \"kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69\") pod \"0fdb7ea4-d7dd-4242-8fba-4a063716b106\" (UID: \"0fdb7ea4-d7dd-4242-8fba-4a063716b106\") " May 21 20:29:28.157984 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.157944 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk4wg\" (UniqueName: \"kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg\") pod \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " May 21 20:29:28.158156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.158135 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume\") pod \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\" (UID: \"1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf\") " May 21 20:29:28.158647 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.158625 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" (UID: "1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:29:28.160105 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.160082 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg" (OuterVolumeSpecName: "kube-api-access-qk4wg") pod "1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" (UID: "1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf"). InnerVolumeSpecName "kube-api-access-qk4wg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:29:28.160183 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.160150 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69" (OuterVolumeSpecName: "kube-api-access-l5c69") pod "0fdb7ea4-d7dd-4242-8fba-4a063716b106" (UID: "0fdb7ea4-d7dd-4242-8fba-4a063716b106"). InnerVolumeSpecName "kube-api-access-l5c69". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:29:28.259300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.259248 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5c69\" (UniqueName: \"kubernetes.io/projected/0fdb7ea4-d7dd-4242-8fba-4a063716b106-kube-api-access-l5c69\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:29:28.259300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.259289 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk4wg\" (UniqueName: \"kubernetes.io/projected/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-kube-api-access-qk4wg\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:29:28.259300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.259302 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf-extensions-socket-volume\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:29:28.376715 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.376679 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" path="/var/lib/kubelet/pods/0fdb7ea4-d7dd-4242-8fba-4a063716b106/volumes" May 21 20:29:28.377125 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.377108 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" path="/var/lib/kubelet/pods/1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf/volumes" May 21 20:29:28.962183 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.962148 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" event={"ID":"fb824c48-0352-4943-8ef8-58ccf03056e8","Type":"ContainerStarted","Data":"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3"} May 21 20:29:28.962183 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.962186 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" event={"ID":"fb824c48-0352-4943-8ef8-58ccf03056e8","Type":"ContainerStarted","Data":"fa7fbf647ccc42eeb0ad3a1188decdc2014d016483e2ec72215257af3b60dd12"} May 21 20:29:28.962665 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.962225 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:29:28.963560 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.963536 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" event={"ID":"9224dd7a-f720-4854-b29c-6df38856b07e","Type":"ContainerStarted","Data":"5f2f92cf99b49a48ffa0f5af290cdcf92c4f27fe71bbff224a98394cfd86e96d"} May 21 20:29:28.964673 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.964657 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" May 21 20:29:28.964771 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.964659 2551 scope.go:117] "RemoveContainer" containerID="a1d414a7f5619d1920418f1de151f12186f15f6405c10eda6ed55ebaf893fd92" May 21 20:29:28.965824 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.965810 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" May 21 20:29:28.967529 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.967505 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" event={"ID":"1626f50d-01fd-4b29-bac2-d8ffd354a796","Type":"ContainerStarted","Data":"f84807c780db8ca620925f02762dba006d09b62362b0c13bb4692965d86b601b"} May 21 20:29:28.967615 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.967537 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" event={"ID":"1626f50d-01fd-4b29-bac2-d8ffd354a796","Type":"ContainerStarted","Data":"1b9cceb27338d2a1a14345cd755764e07f6b6311d087d6009ac933cc08b938e5"} May 21 20:29:28.967678 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.967642 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:28.972637 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.972618 2551 scope.go:117] "RemoveContainer" containerID="a8eeec56ad44f3aff3b027f7636c90e7b403637088d795efa5e438f7a013893e" May 21 20:29:28.986743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.986704 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" podStartSLOduration=12.986692138 podStartE2EDuration="12.986692138s" podCreationTimestamp="2026-05-21 20:29:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:29:28.986503266 +0000 UTC m=+525.214450700" watchObservedRunningTime="2026-05-21 20:29:28.986692138 +0000 UTC m=+525.214639570" May 21 20:29:28.988554 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.988439 2551 status_manager.go:895] "Failed to get status for pod" podUID="0fdb7ea4-d7dd-4242-8fba-4a063716b106" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9kvsj" err="pods \"limitador-operator-controller-manager-85c4996f8c-9kvsj\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:28.990261 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:28.990236 2551 status_manager.go:895] "Failed to get status for pod" podUID="1ad7dee4-9de8-4c2c-aaea-900ab5bd71bf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-5tb8d" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-5tb8d\" is forbidden: User \"system:node:ip-10-0-130-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-74.ec2.internal' and this object" May 21 20:29:29.007034 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:29.006978 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" podStartSLOduration=14.006954953 podStartE2EDuration="14.006954953s" podCreationTimestamp="2026-05-21 20:29:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:29:29.006474269 +0000 UTC m=+525.234421740" watchObservedRunningTime="2026-05-21 20:29:29.006954953 +0000 UTC m=+525.234902388" May 21 20:29:29.024827 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:29.024776 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4fsr" podStartSLOduration=1.5837807270000002 podStartE2EDuration="24.024761794s" podCreationTimestamp="2026-05-21 20:29:05 +0000 UTC" firstStartedPulling="2026-05-21 20:29:05.590892924 +0000 UTC m=+501.818840338" lastFinishedPulling="2026-05-21 20:29:28.031873988 +0000 UTC m=+524.259821405" observedRunningTime="2026-05-21 20:29:29.022909009 +0000 UTC m=+525.250856441" watchObservedRunningTime="2026-05-21 20:29:29.024761794 +0000 UTC m=+525.252709227" May 21 20:29:39.977456 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:39.977418 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-msjtx" May 21 20:29:39.978053 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:29:39.977490 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:30:02.751573 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:02.751527 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:30:02.754766 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:02.754736 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:30:02.757291 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:02.757260 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zbwrw\"" May 21 20:30:02.761732 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:02.761703 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:30:02.943177 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:02.943134 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvwv\" (UniqueName: \"kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv\") pod \"authorino-7498df8756-76nxm\" (UID: \"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f\") " pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:30:03.044490 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:03.044397 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvwv\" (UniqueName: \"kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv\") pod \"authorino-7498df8756-76nxm\" (UID: \"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f\") " pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:30:03.052294 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:03.052262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvwv\" (UniqueName: \"kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv\") pod \"authorino-7498df8756-76nxm\" (UID: \"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f\") " pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:30:03.065043 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:03.065007 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:30:03.199598 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:03.199563 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:30:03.203125 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:30:03.203088 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d32dcb9_0c1f_4084_bb40_c2e7b040a64f.slice/crio-3da4e853b8eff61415f65bd9f11ec5011ffa07be547adcda22ad1ebbfd84aef5 WatchSource:0}: Error finding container 3da4e853b8eff61415f65bd9f11ec5011ffa07be547adcda22ad1ebbfd84aef5: Status 404 returned error can't find the container with id 3da4e853b8eff61415f65bd9f11ec5011ffa07be547adcda22ad1ebbfd84aef5 May 21 20:30:04.088141 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:04.088093 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-76nxm" event={"ID":"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f","Type":"ContainerStarted","Data":"3da4e853b8eff61415f65bd9f11ec5011ffa07be547adcda22ad1ebbfd84aef5"} May 21 20:30:07.098999 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:07.098964 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-76nxm" event={"ID":"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f","Type":"ContainerStarted","Data":"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10"} May 21 20:30:07.115882 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:07.115796 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-76nxm" podStartSLOduration=2.240172476 podStartE2EDuration="5.115776208s" podCreationTimestamp="2026-05-21 20:30:02 +0000 UTC" firstStartedPulling="2026-05-21 20:30:03.204706894 +0000 UTC m=+559.432654304" lastFinishedPulling="2026-05-21 20:30:06.080310625 +0000 UTC m=+562.308258036" observedRunningTime="2026-05-21 20:30:07.113665177 +0000 UTC m=+563.341612609" watchObservedRunningTime="2026-05-21 20:30:07.115776208 +0000 UTC m=+563.343723641" May 21 20:30:44.304735 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:44.304706 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:30:44.306926 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:44.306901 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:30:55.519379 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.519337 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:30:55.524832 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.524806 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:30:55.528317 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.528293 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p4r5z\"" May 21 20:30:55.528455 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.528293 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 21 20:30:55.528993 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.528975 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 21 20:30:55.529039 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.528996 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 21 20:30:55.533014 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.532988 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:30:55.675183 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.675135 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868ng\" (UniqueName: \"kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng\") pod \"maas-keycloak-0\" (UID: \"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:30:55.775646 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.775549 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-868ng\" (UniqueName: \"kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng\") pod \"maas-keycloak-0\" (UID: \"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:30:55.784268 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.784237 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-868ng\" (UniqueName: \"kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng\") pod \"maas-keycloak-0\" (UID: \"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:30:55.836083 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.836043 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:30:55.973309 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:55.973279 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:30:55.975976 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:30:55.975944 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8023ef1_4ce5_45cc_8e9e_f8525a8299d7.slice/crio-066041b5aec5f864ae264c426d64e695ef95f7033d807bb480ee3941fcdd6b9f WatchSource:0}: Error finding container 066041b5aec5f864ae264c426d64e695ef95f7033d807bb480ee3941fcdd6b9f: Status 404 returned error can't find the container with id 066041b5aec5f864ae264c426d64e695ef95f7033d807bb480ee3941fcdd6b9f May 21 20:30:56.252588 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:30:56.252546 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7","Type":"ContainerStarted","Data":"066041b5aec5f864ae264c426d64e695ef95f7033d807bb480ee3941fcdd6b9f"} May 21 20:31:01.273363 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:01.273319 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7","Type":"ContainerStarted","Data":"c4a423e7d4ea6048d94c9ea0080f82bcf644c726f5977318398e66e957ed3b36"} May 21 20:31:01.292932 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:01.292863 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.899757273 podStartE2EDuration="6.292818654s" podCreationTimestamp="2026-05-21 20:30:55 +0000 UTC" firstStartedPulling="2026-05-21 20:30:55.977248556 +0000 UTC m=+612.205195967" lastFinishedPulling="2026-05-21 20:31:00.370309935 +0000 UTC m=+616.598257348" observedRunningTime="2026-05-21 20:31:01.291139314 +0000 UTC m=+617.519086747" watchObservedRunningTime="2026-05-21 20:31:01.292818654 +0000 UTC m=+617.520766088" May 21 20:31:01.836432 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:01.836392 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 21 20:31:01.838214 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:01.838173 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:02.837119 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:02.837063 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:03.837300 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:03.837245 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:04.837145 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:04.837079 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:05.837528 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:05.837467 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:05.838050 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:05.838032 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 21 20:31:06.837465 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:06.837409 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:07.837613 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:07.837556 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:08.837456 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:08.837415 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:09.837294 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:09.837236 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:10.837085 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:10.837034 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:11.837360 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:11.837305 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:12.836870 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:12.836800 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:13.837327 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:13.837266 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" May 21 20:31:14.974044 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:14.974007 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 21 20:31:14.995062 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:14.994760 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:31:24.980451 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:24.980412 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 21 20:31:26.362727 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.362695 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:31:26.364772 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.364750 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.367167 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.367139 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 20:31:26.377743 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.377712 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:31:26.440878 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.440812 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.441070 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.440898 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsbr\" (UniqueName: \"kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.542244 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.542196 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.542244 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.542249 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsbr\" (UniqueName: \"kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.544778 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.544745 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.549902 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.549882 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsbr\" (UniqueName: \"kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr\") pod \"authorino-5b795bd898-q9x4t\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.676493 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.676403 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:31:26.805930 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:26.805906 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:31:26.808579 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:31:26.808549 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode522886a_355b_4119_9575_6938b170f690.slice/crio-5636de81e947359d33dd5268ebde2e2f54126e985f8650125deadd841a93af7a WatchSource:0}: Error finding container 5636de81e947359d33dd5268ebde2e2f54126e985f8650125deadd841a93af7a: Status 404 returned error can't find the container with id 5636de81e947359d33dd5268ebde2e2f54126e985f8650125deadd841a93af7a May 21 20:31:27.381368 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:27.381334 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b795bd898-q9x4t" event={"ID":"e522886a-355b-4119-9575-6938b170f690","Type":"ContainerStarted","Data":"5636de81e947359d33dd5268ebde2e2f54126e985f8650125deadd841a93af7a"} May 21 20:31:28.385629 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.385595 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b795bd898-q9x4t" event={"ID":"e522886a-355b-4119-9575-6938b170f690","Type":"ContainerStarted","Data":"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c"} May 21 20:31:28.403188 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.403115 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5b795bd898-q9x4t" podStartSLOduration=1.872973879 podStartE2EDuration="2.403099677s" podCreationTimestamp="2026-05-21 20:31:26 +0000 UTC" firstStartedPulling="2026-05-21 20:31:26.810160179 +0000 UTC m=+643.038107591" lastFinishedPulling="2026-05-21 20:31:27.340285979 +0000 UTC m=+643.568233389" observedRunningTime="2026-05-21 20:31:28.401287982 +0000 UTC m=+644.629235415" watchObservedRunningTime="2026-05-21 20:31:28.403099677 +0000 UTC m=+644.631047108" May 21 20:31:28.434633 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.432994 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:31:28.434633 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.433285 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-76nxm" podUID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" containerName="authorino" containerID="cri-o://c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10" gracePeriod=30 May 21 20:31:28.683935 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.683907 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:31:28.758404 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.758368 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjvwv\" (UniqueName: \"kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv\") pod \"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f\" (UID: \"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f\") " May 21 20:31:28.760658 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.760626 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv" (OuterVolumeSpecName: "kube-api-access-xjvwv") pod "7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" (UID: "7d32dcb9-0c1f-4084-bb40-c2e7b040a64f"). InnerVolumeSpecName "kube-api-access-xjvwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:31:28.859195 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:28.859142 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjvwv\" (UniqueName: \"kubernetes.io/projected/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f-kube-api-access-xjvwv\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:31:29.390875 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.390814 2551 generic.go:358] "Generic (PLEG): container finished" podID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" containerID="c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10" exitCode=0 May 21 20:31:29.391316 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.390892 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-76nxm" May 21 20:31:29.391316 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.390887 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-76nxm" event={"ID":"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f","Type":"ContainerDied","Data":"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10"} May 21 20:31:29.391316 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.390931 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-76nxm" event={"ID":"7d32dcb9-0c1f-4084-bb40-c2e7b040a64f","Type":"ContainerDied","Data":"3da4e853b8eff61415f65bd9f11ec5011ffa07be547adcda22ad1ebbfd84aef5"} May 21 20:31:29.391316 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.390950 2551 scope.go:117] "RemoveContainer" containerID="c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10" May 21 20:31:29.399263 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.399239 2551 scope.go:117] "RemoveContainer" containerID="c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10" May 21 20:31:29.399557 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:31:29.399540 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10\": container with ID starting with c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10 not found: ID does not exist" containerID="c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10" May 21 20:31:29.399601 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.399568 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10"} err="failed to get container status \"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10\": rpc error: code = NotFound desc = could not find container \"c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10\": container with ID starting with c0b1b57cf49ddc885cfa94822896876cc03a11ecf6d84e3158e6e82f28317b10 not found: ID does not exist" May 21 20:31:29.410792 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.410754 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:31:29.412777 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:29.412750 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-76nxm"] May 21 20:31:30.377170 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:30.377135 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" path="/var/lib/kubelet/pods/7d32dcb9-0c1f-4084-bb40-c2e7b040a64f/volumes" May 21 20:31:31.851607 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.851568 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:31:31.852012 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.851914 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" containerName="authorino" May 21 20:31:31.852012 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.851927 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" containerName="authorino" May 21 20:31:31.852012 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.851974 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d32dcb9-0c1f-4084-bb40-c2e7b040a64f" containerName="authorino" May 21 20:31:31.855880 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.855833 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:31.858368 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.858347 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 20:31:31.858470 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.858348 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m25cs\"" May 21 20:31:31.861948 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.861924 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:31:31.993954 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:31.989239 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sz4w\" (UniqueName: \"kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w\") pod \"maas-controller-8cc64cdcd-td429\" (UID: \"f45a4f60-812a-4d31-af55-8061a3e54a77\") " pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:32.090134 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:32.090084 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sz4w\" (UniqueName: \"kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w\") pod \"maas-controller-8cc64cdcd-td429\" (UID: \"f45a4f60-812a-4d31-af55-8061a3e54a77\") " pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:32.098779 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:32.098747 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sz4w\" (UniqueName: \"kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w\") pod \"maas-controller-8cc64cdcd-td429\" (UID: \"f45a4f60-812a-4d31-af55-8061a3e54a77\") " pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:32.167662 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:32.167566 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:32.306810 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:32.306780 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:31:32.309387 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:31:32.309351 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45a4f60_812a_4d31_af55_8061a3e54a77.slice/crio-a23e07e3ebe7202d2adf3401d5279850d281b35ed9a73f6b1de48f451e442623 WatchSource:0}: Error finding container a23e07e3ebe7202d2adf3401d5279850d281b35ed9a73f6b1de48f451e442623: Status 404 returned error can't find the container with id a23e07e3ebe7202d2adf3401d5279850d281b35ed9a73f6b1de48f451e442623 May 21 20:31:32.405449 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:32.405408 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cc64cdcd-td429" event={"ID":"f45a4f60-812a-4d31-af55-8061a3e54a77","Type":"ContainerStarted","Data":"a23e07e3ebe7202d2adf3401d5279850d281b35ed9a73f6b1de48f451e442623"} May 21 20:31:35.416389 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:35.416351 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cc64cdcd-td429" event={"ID":"f45a4f60-812a-4d31-af55-8061a3e54a77","Type":"ContainerStarted","Data":"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a"} May 21 20:31:35.416785 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:35.416489 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:31:35.438536 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:35.438488 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8cc64cdcd-td429" podStartSLOduration=2.113696606 podStartE2EDuration="4.438472908s" podCreationTimestamp="2026-05-21 20:31:31 +0000 UTC" firstStartedPulling="2026-05-21 20:31:32.310658592 +0000 UTC m=+648.538606002" lastFinishedPulling="2026-05-21 20:31:34.635434891 +0000 UTC m=+650.863382304" observedRunningTime="2026-05-21 20:31:35.437281957 +0000 UTC m=+651.665229389" watchObservedRunningTime="2026-05-21 20:31:35.438472908 +0000 UTC m=+651.666420368" May 21 20:31:46.425717 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:31:46.425672 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:32:00.077888 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.077835 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:32:00.078309 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.078123 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-8cc64cdcd-td429" podUID="f45a4f60-812a-4d31-af55-8061a3e54a77" containerName="manager" containerID="cri-o://d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a" gracePeriod=30 May 21 20:32:00.327329 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.327302 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:32:00.435233 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.435191 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sz4w\" (UniqueName: \"kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w\") pod \"f45a4f60-812a-4d31-af55-8061a3e54a77\" (UID: \"f45a4f60-812a-4d31-af55-8061a3e54a77\") " May 21 20:32:00.437575 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.437549 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w" (OuterVolumeSpecName: "kube-api-access-5sz4w") pod "f45a4f60-812a-4d31-af55-8061a3e54a77" (UID: "f45a4f60-812a-4d31-af55-8061a3e54a77"). InnerVolumeSpecName "kube-api-access-5sz4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:32:00.506444 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.506405 2551 generic.go:358] "Generic (PLEG): container finished" podID="f45a4f60-812a-4d31-af55-8061a3e54a77" containerID="d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a" exitCode=0 May 21 20:32:00.506594 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.506469 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cc64cdcd-td429" May 21 20:32:00.506594 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.506486 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cc64cdcd-td429" event={"ID":"f45a4f60-812a-4d31-af55-8061a3e54a77","Type":"ContainerDied","Data":"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a"} May 21 20:32:00.506594 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.506524 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cc64cdcd-td429" event={"ID":"f45a4f60-812a-4d31-af55-8061a3e54a77","Type":"ContainerDied","Data":"a23e07e3ebe7202d2adf3401d5279850d281b35ed9a73f6b1de48f451e442623"} May 21 20:32:00.506594 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.506541 2551 scope.go:117] "RemoveContainer" containerID="d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a" May 21 20:32:00.515755 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.515731 2551 scope.go:117] "RemoveContainer" containerID="d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a" May 21 20:32:00.516147 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:32:00.516125 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a\": container with ID starting with d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a not found: ID does not exist" containerID="d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a" May 21 20:32:00.516239 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.516159 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a"} err="failed to get container status \"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a\": rpc error: code = NotFound desc = could not find container \"d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a\": container with ID starting with d9393cd2bbaab2b635e6f4e62c4d49fefb19a44e957497c3ad7d850b6d36631a not found: ID does not exist" May 21 20:32:00.527665 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.527628 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:32:00.528952 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.528929 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8cc64cdcd-td429"] May 21 20:32:00.536751 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:00.536722 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sz4w\" (UniqueName: \"kubernetes.io/projected/f45a4f60-812a-4d31-af55-8061a3e54a77-kube-api-access-5sz4w\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:32:02.377431 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:02.377396 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45a4f60-812a-4d31-af55-8061a3e54a77" path="/var/lib/kubelet/pods/f45a4f60-812a-4d31-af55-8061a3e54a77/volumes" May 21 20:32:18.005357 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:18.005314 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:18.005914 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:18.005558 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" containerID="cri-o://c4a423e7d4ea6048d94c9ea0080f82bcf644c726f5977318398e66e957ed3b36" gracePeriod=30 May 21 20:32:19.568389 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:19.568351 2551 generic.go:358] "Generic (PLEG): container finished" podID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerID="c4a423e7d4ea6048d94c9ea0080f82bcf644c726f5977318398e66e957ed3b36" exitCode=143 May 21 20:32:19.568792 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:19.568447 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7","Type":"ContainerDied","Data":"c4a423e7d4ea6048d94c9ea0080f82bcf644c726f5977318398e66e957ed3b36"} May 21 20:32:20.048964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.048935 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.095065 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.095026 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-868ng\" (UniqueName: \"kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng\") pod \"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7\" (UID: \"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7\") " May 21 20:32:20.097436 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.097404 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng" (OuterVolumeSpecName: "kube-api-access-868ng") pod "d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" (UID: "d8023ef1-4ce5-45cc-8e9e-f8525a8299d7"). InnerVolumeSpecName "kube-api-access-868ng". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:32:20.196209 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.196105 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-868ng\" (UniqueName: \"kubernetes.io/projected/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7-kube-api-access-868ng\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:32:20.573501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.573415 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d8023ef1-4ce5-45cc-8e9e-f8525a8299d7","Type":"ContainerDied","Data":"066041b5aec5f864ae264c426d64e695ef95f7033d807bb480ee3941fcdd6b9f"} May 21 20:32:20.573501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.573463 2551 scope.go:117] "RemoveContainer" containerID="c4a423e7d4ea6048d94c9ea0080f82bcf644c726f5977318398e66e957ed3b36" May 21 20:32:20.573501 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.573478 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.590578 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.590549 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:20.594935 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.594909 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:20.616818 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.616787 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:20.617101 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617088 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" May 21 20:32:20.617156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617103 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" May 21 20:32:20.617156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617111 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45a4f60-812a-4d31-af55-8061a3e54a77" containerName="manager" May 21 20:32:20.617156 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617116 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45a4f60-812a-4d31-af55-8061a3e54a77" containerName="manager" May 21 20:32:20.617245 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617173 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="f45a4f60-812a-4d31-af55-8061a3e54a77" containerName="manager" May 21 20:32:20.617245 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.617180 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" containerName="keycloak" May 21 20:32:20.621580 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.621553 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.624114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.624092 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 21 20:32:20.624258 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.624133 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 21 20:32:20.624258 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.624183 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 21 20:32:20.624258 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.624215 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 21 20:32:20.624397 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.624264 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p4r5z\"" May 21 20:32:20.631027 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.630988 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:20.701281 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.701233 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/01b724a0-d23c-456b-b5fa-29df6172abe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.701281 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.701285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmqh\" (UniqueName: \"kubernetes.io/projected/01b724a0-d23c-456b-b5fa-29df6172abe7-kube-api-access-sbmqh\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.801771 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.801728 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/01b724a0-d23c-456b-b5fa-29df6172abe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.801771 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.801773 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmqh\" (UniqueName: \"kubernetes.io/projected/01b724a0-d23c-456b-b5fa-29df6172abe7-kube-api-access-sbmqh\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.802497 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.802469 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/01b724a0-d23c-456b-b5fa-29df6172abe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.810865 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.810801 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmqh\" (UniqueName: \"kubernetes.io/projected/01b724a0-d23c-456b-b5fa-29df6172abe7-kube-api-access-sbmqh\") pod \"maas-keycloak-0\" (UID: \"01b724a0-d23c-456b-b5fa-29df6172abe7\") " pod="keycloak-system/maas-keycloak-0" May 21 20:32:20.932194 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:20.932154 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 21 20:32:21.074298 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.074261 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 21 20:32:21.077095 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:32:21.077057 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b724a0_d23c_456b_b5fa_29df6172abe7.slice/crio-00ab2482a1662937873f7fa749c57dcf8017296a4b993115df2beea9c5ad1949 WatchSource:0}: Error finding container 00ab2482a1662937873f7fa749c57dcf8017296a4b993115df2beea9c5ad1949: Status 404 returned error can't find the container with id 00ab2482a1662937873f7fa749c57dcf8017296a4b993115df2beea9c5ad1949 May 21 20:32:21.078295 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.078277 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:32:21.579098 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.579056 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"01b724a0-d23c-456b-b5fa-29df6172abe7","Type":"ContainerStarted","Data":"24449afa66cd147712488f513c40ca472a7d5dc341c6b6d7f7f7c11895049529"} May 21 20:32:21.579098 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.579090 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"01b724a0-d23c-456b-b5fa-29df6172abe7","Type":"ContainerStarted","Data":"00ab2482a1662937873f7fa749c57dcf8017296a4b993115df2beea9c5ad1949"} May 21 20:32:21.598747 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.598681 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.238357573 podStartE2EDuration="1.598664142s" podCreationTimestamp="2026-05-21 20:32:20 +0000 UTC" firstStartedPulling="2026-05-21 20:32:21.078398279 +0000 UTC m=+697.306345689" lastFinishedPulling="2026-05-21 20:32:21.438704847 +0000 UTC m=+697.666652258" observedRunningTime="2026-05-21 20:32:21.597368382 +0000 UTC m=+697.825315814" watchObservedRunningTime="2026-05-21 20:32:21.598664142 +0000 UTC m=+697.826611576" May 21 20:32:21.932525 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.932480 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 21 20:32:21.934391 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:21.934347 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:22.377468 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:22.377428 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8023ef1-4ce5-45cc-8e9e-f8525a8299d7" path="/var/lib/kubelet/pods/d8023ef1-4ce5-45cc-8e9e-f8525a8299d7/volumes" May 21 20:32:22.933251 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:22.932865 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:23.933325 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:23.933273 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:24.932813 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:24.932759 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:25.933990 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:25.933493 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:26.933210 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:26.933108 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:27.933607 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:27.933558 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:28.933741 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:28.933689 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:29.932950 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:29.932892 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:30.932419 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:30.932354 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 21 20:32:30.932966 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:30.932671 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:31.933628 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:31.933581 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:32.932796 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:32.932739 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:33.933638 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:33.933588 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" May 21 20:32:35.055620 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:35.055575 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 21 20:32:35.076397 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:35.076346 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:32:45.060180 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:45.060134 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="01b724a0-d23c-456b-b5fa-29df6172abe7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:32:55.061706 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:32:55.061670 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 21 20:33:07.725652 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:07.725611 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:33:07.726151 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:07.725949 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5b795bd898-q9x4t" podUID="e522886a-355b-4119-9575-6938b170f690" containerName="authorino" containerID="cri-o://71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c" gracePeriod=30 May 21 20:33:07.994947 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:07.994908 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:33:08.111033 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.110992 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdsbr\" (UniqueName: \"kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr\") pod \"e522886a-355b-4119-9575-6938b170f690\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " May 21 20:33:08.111229 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.111149 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert\") pod \"e522886a-355b-4119-9575-6938b170f690\" (UID: \"e522886a-355b-4119-9575-6938b170f690\") " May 21 20:33:08.113389 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.113344 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr" (OuterVolumeSpecName: "kube-api-access-kdsbr") pod "e522886a-355b-4119-9575-6938b170f690" (UID: "e522886a-355b-4119-9575-6938b170f690"). InnerVolumeSpecName "kube-api-access-kdsbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:33:08.122710 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.122675 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e522886a-355b-4119-9575-6938b170f690" (UID: "e522886a-355b-4119-9575-6938b170f690"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:33:08.212232 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.212200 2551 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e522886a-355b-4119-9575-6938b170f690-tls-cert\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:33:08.212232 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.212228 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdsbr\" (UniqueName: \"kubernetes.io/projected/e522886a-355b-4119-9575-6938b170f690-kube-api-access-kdsbr\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:33:08.745070 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.745040 2551 generic.go:358] "Generic (PLEG): container finished" podID="e522886a-355b-4119-9575-6938b170f690" containerID="71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c" exitCode=0 May 21 20:33:08.745480 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.745084 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b795bd898-q9x4t" event={"ID":"e522886a-355b-4119-9575-6938b170f690","Type":"ContainerDied","Data":"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c"} May 21 20:33:08.745480 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.745107 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b795bd898-q9x4t" event={"ID":"e522886a-355b-4119-9575-6938b170f690","Type":"ContainerDied","Data":"5636de81e947359d33dd5268ebde2e2f54126e985f8650125deadd841a93af7a"} May 21 20:33:08.745480 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.745097 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b795bd898-q9x4t" May 21 20:33:08.745480 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.745121 2551 scope.go:117] "RemoveContainer" containerID="71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c" May 21 20:33:08.758541 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.758514 2551 scope.go:117] "RemoveContainer" containerID="71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c" May 21 20:33:08.758875 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:33:08.758829 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c\": container with ID starting with 71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c not found: ID does not exist" containerID="71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c" May 21 20:33:08.758949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.758884 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c"} err="failed to get container status \"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c\": rpc error: code = NotFound desc = could not find container \"71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c\": container with ID starting with 71683989e203a45c64c4698c7854ebbedbd23542e9b9c48c978f38af5ec3eb0c not found: ID does not exist" May 21 20:33:08.769114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.769080 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:33:08.775861 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:08.775824 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b795bd898-q9x4t"] May 21 20:33:10.377026 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:10.376988 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e522886a-355b-4119-9575-6938b170f690" path="/var/lib/kubelet/pods/e522886a-355b-4119-9575-6938b170f690/volumes" May 21 20:33:15.269877 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.269824 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn"] May 21 20:33:15.270245 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.270145 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e522886a-355b-4119-9575-6938b170f690" containerName="authorino" May 21 20:33:15.270245 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.270157 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e522886a-355b-4119-9575-6938b170f690" containerName="authorino" May 21 20:33:15.270245 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.270210 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="e522886a-355b-4119-9575-6938b170f690" containerName="authorino" May 21 20:33:15.274573 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.274552 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.276948 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.276922 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 20:33:15.277858 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.277817 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 20:33:15.277858 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.277830 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2v2zc\"" May 21 20:33:15.277858 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.277828 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 20:33:15.281760 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.281735 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn"] May 21 20:33:15.369776 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369744 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.369964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369784 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.369964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369811 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.369964 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b64613-ab59-47d4-a219-97b15e00be09-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.370091 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369968 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.370091 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.369995 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxg6\" (UniqueName: \"kubernetes.io/projected/70b64613-ab59-47d4-a219-97b15e00be09-kube-api-access-rcxg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471032 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.470991 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxg6\" (UniqueName: \"kubernetes.io/projected/70b64613-ab59-47d4-a219-97b15e00be09-kube-api-access-rcxg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471225 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471074 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471225 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471109 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471225 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471140 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471385 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471282 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b64613-ab59-47d4-a219-97b15e00be09-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471385 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471364 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471518 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471498 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471591 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471569 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.471645 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.471592 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.473802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.473780 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b64613-ab59-47d4-a219-97b15e00be09-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.474015 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.473998 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b64613-ab59-47d4-a219-97b15e00be09-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.509953 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.509915 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxg6\" (UniqueName: \"kubernetes.io/projected/70b64613-ab59-47d4-a219-97b15e00be09-kube-api-access-rcxg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn\" (UID: \"70b64613-ab59-47d4-a219-97b15e00be09\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.586047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.585957 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:15.725718 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.725676 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn"] May 21 20:33:15.728547 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:33:15.728517 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b64613_ab59_47d4_a219_97b15e00be09.slice/crio-90cd74fe8d5802192c903fa581a3c979e6c09b40328ed5fbd3cb77b532e9e9c0 WatchSource:0}: Error finding container 90cd74fe8d5802192c903fa581a3c979e6c09b40328ed5fbd3cb77b532e9e9c0: Status 404 returned error can't find the container with id 90cd74fe8d5802192c903fa581a3c979e6c09b40328ed5fbd3cb77b532e9e9c0 May 21 20:33:15.768374 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:15.768335 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" event={"ID":"70b64613-ab59-47d4-a219-97b15e00be09","Type":"ContainerStarted","Data":"90cd74fe8d5802192c903fa581a3c979e6c09b40328ed5fbd3cb77b532e9e9c0"} May 21 20:33:18.873932 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:18.873889 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf"] May 21 20:33:18.877603 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:18.877569 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:18.880333 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:18.880306 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 20:33:18.889451 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:18.889400 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf"] May 21 20:33:19.007889 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.007826 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.008084 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.007916 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.008084 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.007946 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.008084 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.007962 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.008084 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.008019 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xwc\" (UniqueName: \"kubernetes.io/projected/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kube-api-access-q9xwc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.008263 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.008088 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109392 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109344 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109392 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109396 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109666 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109543 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109666 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109597 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109666 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109645 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xwc\" (UniqueName: \"kubernetes.io/projected/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kube-api-access-q9xwc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109803 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109695 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109888 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109802 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.109888 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.109839 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.110115 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.110085 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.112034 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.112004 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.112378 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.112362 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.117486 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.117462 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xwc\" (UniqueName: \"kubernetes.io/projected/a3153ea8-0cb2-4d6b-b075-96db456bfa6f-kube-api-access-q9xwc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf\" (UID: \"a3153ea8-0cb2-4d6b-b075-96db456bfa6f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.192726 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.192626 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:19.357694 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.357662 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf"] May 21 20:33:19.360971 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:33:19.360921 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3153ea8_0cb2_4d6b_b075_96db456bfa6f.slice/crio-aef73ad06157a3fa5c6331314ebfbdb4f9c58219ad55df34dc4febb53a6e8654 WatchSource:0}: Error finding container aef73ad06157a3fa5c6331314ebfbdb4f9c58219ad55df34dc4febb53a6e8654: Status 404 returned error can't find the container with id aef73ad06157a3fa5c6331314ebfbdb4f9c58219ad55df34dc4febb53a6e8654 May 21 20:33:19.784103 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:19.784050 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" event={"ID":"a3153ea8-0cb2-4d6b-b075-96db456bfa6f","Type":"ContainerStarted","Data":"aef73ad06157a3fa5c6331314ebfbdb4f9c58219ad55df34dc4febb53a6e8654"} May 21 20:33:22.795580 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:22.795533 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" event={"ID":"70b64613-ab59-47d4-a219-97b15e00be09","Type":"ContainerStarted","Data":"98a60e021262f8061b817f2e4866246c32db9f4450e515247d83b2318a884dce"} May 21 20:33:22.797215 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:22.797181 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" event={"ID":"a3153ea8-0cb2-4d6b-b075-96db456bfa6f","Type":"ContainerStarted","Data":"e56f164696afcc6d61bd255ecd140df2571ded1a3bee3900aa2c1d9dab10ce35"} May 21 20:33:28.672902 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.672859 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4"] May 21 20:33:28.678653 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.678622 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.681799 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.681774 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 20:33:28.684750 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.684725 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4"] May 21 20:33:28.803229 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803177 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.803229 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803238 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.803442 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803294 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.803442 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803316 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.803442 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803385 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjhm\" (UniqueName: \"kubernetes.io/projected/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kube-api-access-ppjhm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.803542 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.803466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.823107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.823074 2551 generic.go:358] "Generic (PLEG): container finished" podID="a3153ea8-0cb2-4d6b-b075-96db456bfa6f" containerID="e56f164696afcc6d61bd255ecd140df2571ded1a3bee3900aa2c1d9dab10ce35" exitCode=0 May 21 20:33:28.823286 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.823151 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" event={"ID":"a3153ea8-0cb2-4d6b-b075-96db456bfa6f","Type":"ContainerDied","Data":"e56f164696afcc6d61bd255ecd140df2571ded1a3bee3900aa2c1d9dab10ce35"} May 21 20:33:28.824638 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.824578 2551 generic.go:358] "Generic (PLEG): container finished" podID="70b64613-ab59-47d4-a219-97b15e00be09" containerID="98a60e021262f8061b817f2e4866246c32db9f4450e515247d83b2318a884dce" exitCode=0 May 21 20:33:28.824691 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.824638 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" event={"ID":"70b64613-ab59-47d4-a219-97b15e00be09","Type":"ContainerDied","Data":"98a60e021262f8061b817f2e4866246c32db9f4450e515247d83b2318a884dce"} May 21 20:33:28.904535 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904489 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.904730 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904684 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.904802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904726 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.904802 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904770 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjhm\" (UniqueName: \"kubernetes.io/projected/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kube-api-access-ppjhm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.904954 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904819 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.905010 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904961 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.905010 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.904978 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.905114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.905055 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.905412 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.905392 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.907247 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.907229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.907502 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.907482 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.913166 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.913142 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjhm\" (UniqueName: \"kubernetes.io/projected/19bd9bf6-86d6-4f31-a298-8ac7f1f669e7-kube-api-access-ppjhm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4\" (UID: \"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:28.990107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:28.989998 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:29.132142 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:29.131834 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4"] May 21 20:33:29.134290 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:33:29.134251 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bd9bf6_86d6_4f31_a298_8ac7f1f669e7.slice/crio-c069157e496d1354c440209fbb56c783fd159789dcedc90ea5e0ff867ff63b8c WatchSource:0}: Error finding container c069157e496d1354c440209fbb56c783fd159789dcedc90ea5e0ff867ff63b8c: Status 404 returned error can't find the container with id c069157e496d1354c440209fbb56c783fd159789dcedc90ea5e0ff867ff63b8c May 21 20:33:29.829927 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:29.829887 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" event={"ID":"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7","Type":"ContainerStarted","Data":"4e3d67eaf7fb4e5145122b832ab754d086ff337d87edc978ddfd49c9769f3ec1"} May 21 20:33:29.829927 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:29.829929 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" event={"ID":"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7","Type":"ContainerStarted","Data":"c069157e496d1354c440209fbb56c783fd159789dcedc90ea5e0ff867ff63b8c"} May 21 20:33:30.836016 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.835972 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" event={"ID":"a3153ea8-0cb2-4d6b-b075-96db456bfa6f","Type":"ContainerStarted","Data":"6d37ad07c4561ae797a980bcfa5158f366a43124154bf57f157c9cb48426a568"} May 21 20:33:30.836450 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.836201 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:30.837805 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.837780 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" event={"ID":"70b64613-ab59-47d4-a219-97b15e00be09","Type":"ContainerStarted","Data":"6fceb80ceedb990e9d1832876f9ac64f946f961162d3f83bb2de54e7e4b9b28d"} May 21 20:33:30.838173 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.838150 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:30.855620 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.855562 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" podStartSLOduration=2.009989113 podStartE2EDuration="12.855548881s" podCreationTimestamp="2026-05-21 20:33:18 +0000 UTC" firstStartedPulling="2026-05-21 20:33:19.364062495 +0000 UTC m=+755.592009909" lastFinishedPulling="2026-05-21 20:33:30.209622154 +0000 UTC m=+766.437569677" observedRunningTime="2026-05-21 20:33:30.85410939 +0000 UTC m=+767.082056815" watchObservedRunningTime="2026-05-21 20:33:30.855548881 +0000 UTC m=+767.083496313" May 21 20:33:30.872832 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:30.872772 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" podStartSLOduration=1.37676022 podStartE2EDuration="15.872751266s" podCreationTimestamp="2026-05-21 20:33:15 +0000 UTC" firstStartedPulling="2026-05-21 20:33:15.730158622 +0000 UTC m=+751.958106031" lastFinishedPulling="2026-05-21 20:33:30.226149652 +0000 UTC m=+766.454097077" observedRunningTime="2026-05-21 20:33:30.872372396 +0000 UTC m=+767.100319851" watchObservedRunningTime="2026-05-21 20:33:30.872751266 +0000 UTC m=+767.100698697" May 21 20:33:35.858078 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:35.858044 2551 generic.go:358] "Generic (PLEG): container finished" podID="19bd9bf6-86d6-4f31-a298-8ac7f1f669e7" containerID="4e3d67eaf7fb4e5145122b832ab754d086ff337d87edc978ddfd49c9769f3ec1" exitCode=0 May 21 20:33:35.858078 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:35.858088 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" event={"ID":"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7","Type":"ContainerDied","Data":"4e3d67eaf7fb4e5145122b832ab754d086ff337d87edc978ddfd49c9769f3ec1"} May 21 20:33:36.862837 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:36.862791 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" event={"ID":"19bd9bf6-86d6-4f31-a298-8ac7f1f669e7","Type":"ContainerStarted","Data":"0a3a3b2550a535097c11f76bf1a83459fbb54592c1a3bbb357e6eed7c37151f6"} May 21 20:33:36.863343 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:36.863094 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:36.885339 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:36.885285 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" podStartSLOduration=8.606192873 podStartE2EDuration="8.885267792s" podCreationTimestamp="2026-05-21 20:33:28 +0000 UTC" firstStartedPulling="2026-05-21 20:33:35.858797261 +0000 UTC m=+772.086744672" lastFinishedPulling="2026-05-21 20:33:36.137872166 +0000 UTC m=+772.365819591" observedRunningTime="2026-05-21 20:33:36.883758632 +0000 UTC m=+773.111706065" watchObservedRunningTime="2026-05-21 20:33:36.885267792 +0000 UTC m=+773.113215224" May 21 20:33:41.862548 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:41.862514 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn" May 21 20:33:41.862969 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:41.862577 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf" May 21 20:33:42.977597 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:42.977552 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4"] May 21 20:33:43.002954 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.002912 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4"] May 21 20:33:43.003133 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.003071 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.005858 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.005823 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 20:33:43.032737 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.032695 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.032737 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.032742 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.033047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.032766 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.033047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.032872 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.033047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.032918 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.033047 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.033032 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfzd5\" (UniqueName: \"kubernetes.io/projected/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kube-api-access-hfzd5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.133933 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.133890 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfzd5\" (UniqueName: \"kubernetes.io/projected/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kube-api-access-hfzd5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.133953 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.133996 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134026 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134114 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134066 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134257 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134208 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134422 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134399 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134498 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134469 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.134572 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.134548 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.136556 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.136531 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.137037 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.137018 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.142680 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.142649 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfzd5\" (UniqueName: \"kubernetes.io/projected/c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a-kube-api-access-hfzd5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b65s4\" (UID: \"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.312892 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.312771 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:43.457690 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.457658 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4"] May 21 20:33:43.888661 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.888608 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" event={"ID":"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a","Type":"ContainerStarted","Data":"d63b74622c69d35b1f617db15537f69ce64fa20e6224385ce626a49869157f09"} May 21 20:33:43.888661 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:43.888664 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" event={"ID":"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a","Type":"ContainerStarted","Data":"e96018afc0dd7d279e14ecbc898cbc2349aadab3c0144568e10bed73f0bc5b83"} May 21 20:33:47.881312 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:47.881271 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4" May 21 20:33:52.924049 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:52.924013 2551 generic.go:358] "Generic (PLEG): container finished" podID="c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a" containerID="d63b74622c69d35b1f617db15537f69ce64fa20e6224385ce626a49869157f09" exitCode=0 May 21 20:33:52.924458 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:52.924096 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" event={"ID":"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a","Type":"ContainerDied","Data":"d63b74622c69d35b1f617db15537f69ce64fa20e6224385ce626a49869157f09"} May 21 20:33:53.929773 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:53.929725 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" event={"ID":"c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a","Type":"ContainerStarted","Data":"7e26e90ca9fc404926741469bbe2c386f214f2c1321b2c86024f3e1298e837f1"} May 21 20:33:53.930267 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:53.930000 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:33:53.947471 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:33:53.947414 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" podStartSLOduration=11.703305708 podStartE2EDuration="11.947393942s" podCreationTimestamp="2026-05-21 20:33:42 +0000 UTC" firstStartedPulling="2026-05-21 20:33:52.924821757 +0000 UTC m=+789.152769167" lastFinishedPulling="2026-05-21 20:33:53.168909983 +0000 UTC m=+789.396857401" observedRunningTime="2026-05-21 20:33:53.94621527 +0000 UTC m=+790.174162703" watchObservedRunningTime="2026-05-21 20:33:53.947393942 +0000 UTC m=+790.175341373" May 21 20:34:04.946941 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:34:04.946838 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b65s4" May 21 20:35:44.333082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:35:44.333051 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:35:44.333082 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:35:44.333082 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:40:44.358275 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:40:44.358238 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:40:44.359093 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:40:44.359079 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:45:44.382035 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:45:44.382009 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:45:44.383548 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:45:44.383528 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:46:13.712469 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:13.712375 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:46:13.712949 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:13.712688 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" podUID="fb824c48-0352-4943-8ef8-58ccf03056e8" containerName="manager" containerID="cri-o://1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3" gracePeriod=10 May 21 20:46:14.269515 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.269489 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:46:14.359671 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.359625 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume\") pod \"fb824c48-0352-4943-8ef8-58ccf03056e8\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " May 21 20:46:14.359671 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.359667 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s799z\" (UniqueName: \"kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z\") pod \"fb824c48-0352-4943-8ef8-58ccf03056e8\" (UID: \"fb824c48-0352-4943-8ef8-58ccf03056e8\") " May 21 20:46:14.360125 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.360095 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fb824c48-0352-4943-8ef8-58ccf03056e8" (UID: "fb824c48-0352-4943-8ef8-58ccf03056e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:46:14.361909 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.361875 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z" (OuterVolumeSpecName: "kube-api-access-s799z") pod "fb824c48-0352-4943-8ef8-58ccf03056e8" (UID: "fb824c48-0352-4943-8ef8-58ccf03056e8"). InnerVolumeSpecName "kube-api-access-s799z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:46:14.460533 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.460501 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb824c48-0352-4943-8ef8-58ccf03056e8-extensions-socket-volume\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:46:14.460533 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.460529 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s799z\" (UniqueName: \"kubernetes.io/projected/fb824c48-0352-4943-8ef8-58ccf03056e8-kube-api-access-s799z\") on node \"ip-10-0-130-74.ec2.internal\" DevicePath \"\"" May 21 20:46:14.469406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.469372 2551 generic.go:358] "Generic (PLEG): container finished" podID="fb824c48-0352-4943-8ef8-58ccf03056e8" containerID="1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3" exitCode=0 May 21 20:46:14.469539 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.469438 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" May 21 20:46:14.469539 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.469451 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" event={"ID":"fb824c48-0352-4943-8ef8-58ccf03056e8","Type":"ContainerDied","Data":"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3"} May 21 20:46:14.469539 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.469487 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb" event={"ID":"fb824c48-0352-4943-8ef8-58ccf03056e8","Type":"ContainerDied","Data":"fa7fbf647ccc42eeb0ad3a1188decdc2014d016483e2ec72215257af3b60dd12"} May 21 20:46:14.469539 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.469501 2551 scope.go:117] "RemoveContainer" containerID="1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3" May 21 20:46:14.478393 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.478376 2551 scope.go:117] "RemoveContainer" containerID="1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3" May 21 20:46:14.478654 ip-10-0-130-74 kubenswrapper[2551]: E0521 20:46:14.478634 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3\": container with ID starting with 1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3 not found: ID does not exist" containerID="1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3" May 21 20:46:14.478701 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.478670 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3"} err="failed to get container status \"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3\": rpc error: code = NotFound desc = could not find container \"1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3\": container with ID starting with 1580b0eb71818eae363d73d3b9cb77b4614a66dad202757d11db77437f0e25d3 not found: ID does not exist" May 21 20:46:14.485489 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.485467 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:46:14.489628 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:14.489606 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kd6sb"] May 21 20:46:16.377725 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:46:16.377688 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb824c48-0352-4943-8ef8-58ccf03056e8" path="/var/lib/kubelet/pods/fb824c48-0352-4943-8ef8-58ccf03056e8/volumes" May 21 20:47:19.833273 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.833234 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh"] May 21 20:47:19.833736 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.833602 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb824c48-0352-4943-8ef8-58ccf03056e8" containerName="manager" May 21 20:47:19.833736 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.833615 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb824c48-0352-4943-8ef8-58ccf03056e8" containerName="manager" May 21 20:47:19.833736 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.833680 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb824c48-0352-4943-8ef8-58ccf03056e8" containerName="manager" May 21 20:47:19.836587 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.836570 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:19.838754 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.838732 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggdlz\"" May 21 20:47:19.845180 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:19.845158 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh"] May 21 20:47:20.015450 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.015413 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.015612 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.015522 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbz29\" (UniqueName: \"kubernetes.io/projected/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-kube-api-access-pbz29\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.116294 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.116263 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.116446 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.116327 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbz29\" (UniqueName: \"kubernetes.io/projected/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-kube-api-access-pbz29\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.116692 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.116668 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.127463 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.127438 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbz29\" (UniqueName: \"kubernetes.io/projected/10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2-kube-api-access-pbz29\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qqtlh\" (UID: \"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.147406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.147380 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.281584 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.281560 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh"] May 21 20:47:20.284595 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:47:20.284568 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a3f0ad_c18c_42f7_8ff3_c4a1b4eb8fa2.slice/crio-3f240cd5b8e88b238103d5bd0a31c0ea0a3fef52d1dd710cf19fe549abf1cf32 WatchSource:0}: Error finding container 3f240cd5b8e88b238103d5bd0a31c0ea0a3fef52d1dd710cf19fe549abf1cf32: Status 404 returned error can't find the container with id 3f240cd5b8e88b238103d5bd0a31c0ea0a3fef52d1dd710cf19fe549abf1cf32 May 21 20:47:20.287582 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.287563 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:47:20.697095 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.697057 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" event={"ID":"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2","Type":"ContainerStarted","Data":"2efa281f2057672430d042bb74b33dda4e02248bfce89f141752d592e1715251"} May 21 20:47:20.697280 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.697100 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" event={"ID":"10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2","Type":"ContainerStarted","Data":"3f240cd5b8e88b238103d5bd0a31c0ea0a3fef52d1dd710cf19fe549abf1cf32"} May 21 20:47:20.697280 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.697135 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:47:20.728601 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:20.728545 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" podStartSLOduration=1.7285289339999999 podStartE2EDuration="1.728528934s" podCreationTimestamp="2026-05-21 20:47:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:47:20.728040346 +0000 UTC m=+1596.955987778" watchObservedRunningTime="2026-05-21 20:47:20.728528934 +0000 UTC m=+1596.956476365" May 21 20:47:31.702839 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:47:31.702807 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qqtlh" May 21 20:50:44.406012 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:50:44.405979 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:50:44.408610 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:50:44.408589 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:55:44.427406 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:55:44.427371 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:55:44.431387 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:55:44.431367 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:57:10.464955 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:10.464913 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cb4d6bf5-pqllp_b897ea9a-4150-498f-a770-f8c4303f9967/manager/0.log" May 21 20:57:12.147039 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:12.147002 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ghlt7_b1c7960b-b934-4cf0-aca9-7d3fe71b0768/manager/0.log" May 21 20:57:12.251499 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:12.251470 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-m4fsr_9224dd7a-f720-4854-b29c-6df38856b07e/kuadrant-console-plugin/0.log" May 21 20:57:12.378195 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:12.376912 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dk79f_1d80df1f-a3bd-4a4b-8278-5f801c8e8e54/registry-server/0.log" May 21 20:57:12.506676 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:12.506590 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-qqtlh_10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2/manager/0.log" May 21 20:57:12.750214 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:12.750182 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-msjtx_1626f50d-01fd-4b29-bac2-d8ffd354a796/manager/0.log" May 21 20:57:13.090173 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:13.090139 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr_6e78d180-49eb-4c12-b937-606afce16ab7/istio-proxy/0.log" May 21 20:57:14.206341 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.206316 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4_19bd9bf6-86d6-4f31-a298-8ac7f1f669e7/storage-initializer/0.log" May 21 20:57:14.213422 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.213376 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-nqlz4_19bd9bf6-86d6-4f31-a298-8ac7f1f669e7/main/0.log" May 21 20:57:14.444031 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.443988 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn_70b64613-ab59-47d4-a219-97b15e00be09/storage-initializer/0.log" May 21 20:57:14.451547 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.451489 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc64fhn_70b64613-ab59-47d4-a219-97b15e00be09/main/0.log" May 21 20:57:14.559494 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.559399 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf_a3153ea8-0cb2-4d6b-b075-96db456bfa6f/main/0.log" May 21 20:57:14.565064 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.565031 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vxggf_a3153ea8-0cb2-4d6b-b075-96db456bfa6f/storage-initializer/0.log" May 21 20:57:14.671074 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.671042 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b65s4_c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a/storage-initializer/0.log" May 21 20:57:14.678235 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:14.678204 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b65s4_c7ea5e91-1d9d-4b17-82b2-e02e7064fb2a/main/0.log" May 21 20:57:21.350222 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:21.350175 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-54d7d_e3791107-c06c-44a7-b20f-528923ee1888/global-pull-secret-syncer/0.log" May 21 20:57:21.478053 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:21.478020 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6xrrl_598641f6-a843-45ee-bbb8-3a13d707e78e/konnectivity-agent/0.log" May 21 20:57:21.588073 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:21.588041 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-74.ec2.internal_218dda9ded7f9e55e144b6f5a2217224/haproxy/0.log" May 21 20:57:25.833276 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:25.833243 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ghlt7_b1c7960b-b934-4cf0-aca9-7d3fe71b0768/manager/0.log" May 21 20:57:25.860428 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:25.860401 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-m4fsr_9224dd7a-f720-4854-b29c-6df38856b07e/kuadrant-console-plugin/0.log" May 21 20:57:25.903427 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:25.903400 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dk79f_1d80df1f-a3bd-4a4b-8278-5f801c8e8e54/registry-server/0.log" May 21 20:57:25.990942 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:25.990907 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-qqtlh_10a3f0ad-c18c-42f7-8ff3-c4a1b4eb8fa2/manager/0.log" May 21 20:57:26.100342 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:26.100313 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-msjtx_1626f50d-01fd-4b29-bac2-d8ffd354a796/manager/0.log" May 21 20:57:27.987339 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:27.987304 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qspr6_43efeebb-214b-4533-8b94-23ad6f98b4bb/node-exporter/0.log" May 21 20:57:28.006014 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:28.005965 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qspr6_43efeebb-214b-4533-8b94-23ad6f98b4bb/kube-rbac-proxy/0.log" May 21 20:57:28.044240 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:28.044215 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qspr6_43efeebb-214b-4533-8b94-23ad6f98b4bb/init-textfile/0.log" May 21 20:57:29.668932 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:29.668903 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-pp4q8_df68f186-06a9-4589-a97c-06ad9cc647c2/networking-console-plugin/0.log" May 21 20:57:30.334488 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.334452 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t"] May 21 20:57:30.337749 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.337725 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.339998 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.339978 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2x8m\"/\"kube-root-ca.crt\"" May 21 20:57:30.340923 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.340901 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2x8m\"/\"default-dockercfg-mlx6x\"" May 21 20:57:30.341038 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.341019 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2x8m\"/\"openshift-service-ca.crt\"" May 21 20:57:30.344144 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.344122 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t"] May 21 20:57:30.371348 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.371307 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-podres\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.371507 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.371358 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-sys\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.371507 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.371383 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwrhs\" (UniqueName: \"kubernetes.io/projected/d1616efd-695a-4662-81fa-d7bc506a6c6b-kube-api-access-gwrhs\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.371507 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.371415 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-lib-modules\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.371507 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.371485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-proc\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472286 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472240 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-proc\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472307 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-podres\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472334 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-sys\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472358 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrhs\" (UniqueName: \"kubernetes.io/projected/d1616efd-695a-4662-81fa-d7bc506a6c6b-kube-api-access-gwrhs\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472378 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-proc\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472383 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-lib-modules\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472445 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-sys\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472422 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-podres\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.472481 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.472466 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1616efd-695a-4662-81fa-d7bc506a6c6b-lib-modules\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.480944 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.480915 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrhs\" (UniqueName: \"kubernetes.io/projected/d1616efd-695a-4662-81fa-d7bc506a6c6b-kube-api-access-gwrhs\") pod \"perf-node-gather-daemonset-ssc4t\" (UID: \"d1616efd-695a-4662-81fa-d7bc506a6c6b\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.649458 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.649419 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:30.780911 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.780881 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t"] May 21 20:57:30.785124 ip-10-0-130-74 kubenswrapper[2551]: W0521 20:57:30.785096 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1616efd_695a_4662_81fa_d7bc506a6c6b.slice/crio-1173228f4aa4a39611e35a1dbc77f9fa915050acf45a323e3f328fc8430c9535 WatchSource:0}: Error finding container 1173228f4aa4a39611e35a1dbc77f9fa915050acf45a323e3f328fc8430c9535: Status 404 returned error can't find the container with id 1173228f4aa4a39611e35a1dbc77f9fa915050acf45a323e3f328fc8430c9535 May 21 20:57:30.786775 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:30.786754 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:57:31.776518 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:31.776482 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" event={"ID":"d1616efd-695a-4662-81fa-d7bc506a6c6b","Type":"ContainerStarted","Data":"7bf8610281d33785df16ce8c0c42ece4a0e03b374307ab0809c22c3f4a4965ee"} May 21 20:57:31.776518 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:31.776525 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" event={"ID":"d1616efd-695a-4662-81fa-d7bc506a6c6b","Type":"ContainerStarted","Data":"1173228f4aa4a39611e35a1dbc77f9fa915050acf45a323e3f328fc8430c9535"} May 21 20:57:31.776773 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:31.776580 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:31.790130 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:31.790073 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" podStartSLOduration=1.7900577850000001 podStartE2EDuration="1.790057785s" podCreationTimestamp="2026-05-21 20:57:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:57:31.78955393 +0000 UTC m=+2208.017501368" watchObservedRunningTime="2026-05-21 20:57:31.790057785 +0000 UTC m=+2208.018005217" May 21 20:57:32.124965 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:32.124938 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9qfj_537c94a6-4e4f-4873-90b4-65e7e6a81b1a/dns/0.log" May 21 20:57:32.143596 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:32.143558 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9qfj_537c94a6-4e4f-4873-90b4-65e7e6a81b1a/kube-rbac-proxy/0.log" May 21 20:57:32.207361 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:32.207332 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdbx6_4bd7604b-3c99-4a48-b36e-baf12a2dad78/dns-node-resolver/0.log" May 21 20:57:32.658370 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:32.658319 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrxbs_9b04e2e4-9a63-46ba-99d3-abb3af641249/node-ca/0.log" May 21 20:57:33.514496 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:33.514442 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bwjxmr_6e78d180-49eb-4c12-b937-606afce16ab7/istio-proxy/0.log" May 21 20:57:34.325267 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:34.325232 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2jxr_5b4d1c8c-90db-4b15-bde6-5ab0489b4ba9/serve-healthcheck-canary/0.log" May 21 20:57:34.763690 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:34.763658 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnhtn_74baaaa4-954d-4356-90ab-90ce7497ceb1/kube-rbac-proxy/0.log" May 21 20:57:34.782469 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:34.782440 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnhtn_74baaaa4-954d-4356-90ab-90ce7497ceb1/exporter/0.log" May 21 20:57:34.804164 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:34.804135 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnhtn_74baaaa4-954d-4356-90ab-90ce7497ceb1/extractor/0.log" May 21 20:57:36.983961 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:36.983918 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cb4d6bf5-pqllp_b897ea9a-4150-498f-a770-f8c4303f9967/manager/0.log" May 21 20:57:37.790574 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:37.790543 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-ssc4t" May 21 20:57:38.186081 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:38.186050 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5999fcd7f9-7wmq5_e293ee73-1dbe-44a6-a62b-d8d94cb6ba9c/manager/0.log" May 21 20:57:43.875184 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:43.875130 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4dqtt_080f4e4a-bf3c-4024-975a-8d3fe14d3146/kube-multus/0.log" May 21 20:57:44.201286 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.201201 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/kube-multus-additional-cni-plugins/0.log" May 21 20:57:44.221029 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.220986 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/egress-router-binary-copy/0.log" May 21 20:57:44.240668 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.240641 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/cni-plugins/0.log" May 21 20:57:44.258631 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.258611 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/bond-cni-plugin/0.log" May 21 20:57:44.277107 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.277082 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/routeoverride-cni/0.log" May 21 20:57:44.295194 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.295170 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/whereabouts-cni-bincopy/0.log" May 21 20:57:44.313691 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.313667 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbh5s_dc0646be-be5c-4d1a-8b47-a05776491aea/whereabouts-cni/0.log" May 21 20:57:44.433993 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.433962 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c6rq8_71ba3135-325d-465a-ae56-7bb40941ebb2/network-metrics-daemon/0.log" May 21 20:57:44.450023 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:44.449985 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c6rq8_71ba3135-325d-465a-ae56-7bb40941ebb2/kube-rbac-proxy/0.log" May 21 20:57:45.820204 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.820141 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-controller/0.log" May 21 20:57:45.836085 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.836054 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/0.log" May 21 20:57:45.856818 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.856773 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovn-acl-logging/1.log" May 21 20:57:45.874769 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.874742 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/kube-rbac-proxy-node/0.log" May 21 20:57:45.893835 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.893803 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/kube-rbac-proxy-ovn-metrics/0.log" May 21 20:57:45.913696 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.913668 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/northd/0.log" May 21 20:57:45.934643 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.934605 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/nbdb/0.log" May 21 20:57:45.953504 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:45.953472 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/sbdb/0.log" May 21 20:57:46.128639 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:46.128606 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tcncm_2a171f00-4152-4a3b-852d-308a9783ec5e/ovnkube-controller/0.log" May 21 20:57:47.160996 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:47.160962 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-vr75d_9e7994f0-b1dd-4977-9157-60635f4dea53/check-endpoints/0.log" May 21 20:57:47.227545 ip-10-0-130-74 kubenswrapper[2551]: I0521 20:57:47.227507 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zgrgl_2a0d9808-d358-4c5a-91c9-668f8869d649/network-check-target-container/0.log"