Jun 09 01:12:49.438082 ip-10-0-129-196 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 01:12:49.438094 ip-10-0-129-196 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 01:12:49.438102 ip-10-0-129-196 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 01:12:49.438257 ip-10-0-129-196 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 01:12:59.484359 ip-10-0-129-196 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 01:12:59.484383 ip-10-0-129-196 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fc1d22b83b8140e9955789225ceb8677 -- Jun 09 01:15:56.519162 ip-10-0-129-196 systemd[1]: Starting Kubernetes Kubelet... Jun 09 01:15:56.940627 ip-10-0-129-196 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:56.940627 ip-10-0-129-196 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 01:15:56.940627 ip-10-0-129-196 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:56.940627 ip-10-0-129-196 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 01:15:56.940627 ip-10-0-129-196 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:56.941331 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.940688 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 01:15:56.944770 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944745 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944775 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944782 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944787 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944791 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944793 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944796 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944799 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944802 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944805 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944808 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944811 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944813 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.944812 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944816 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944820 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944823 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944827 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944831 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944834 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944837 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944840 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944844 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944848 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944850 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944853 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944855 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944858 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944861 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944863 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944866 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944868 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944871 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.945123 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944874 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944876 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944879 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944881 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944883 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944886 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944889 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944891 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944894 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944896 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944899 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944902 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944904 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944907 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944909 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944913 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944916 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944918 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944921 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944924 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.945569 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944927 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944930 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944933 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944936 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944939 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944941 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944944 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944946 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944949 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944952 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944954 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944957 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944959 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944962 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944964 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944967 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944969 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944972 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944974 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.946097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944977 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944981 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944985 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944988 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944990 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944993 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944996 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.944998 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945001 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945004 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945008 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945011 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945014 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945017 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945019 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945021 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945024 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945027 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945030 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945032 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.946548 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945035 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945037 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945040 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945042 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945045 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945049 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945053 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945056 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945752 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945774 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945777 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945780 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945783 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945786 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945789 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945792 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945795 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945798 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945801 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945804 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.947075 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945807 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945810 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945812 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945815 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945818 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945822 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945826 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945829 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945832 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945835 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945838 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945841 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945844 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945847 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945850 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945852 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945855 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945858 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945861 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945863 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.947555 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945866 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945868 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945871 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945873 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945876 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945878 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945881 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945884 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945887 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945890 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945892 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945896 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945901 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945904 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945908 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945911 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945914 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945917 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945920 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945923 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.948092 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945925 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945928 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945931 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945934 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945937 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945940 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945946 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945949 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945952 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945955 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945957 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945960 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945963 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945966 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945969 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945971 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945974 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945977 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945979 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.948575 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945982 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945985 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945988 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945991 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945994 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945997 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.945999 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946002 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946004 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946007 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946009 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946012 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946014 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946017 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946019 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946022 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946024 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946027 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946029 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946037 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.949070 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946039 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946042 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946045 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946048 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946050 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946053 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946056 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946058 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946417 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946422 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946424 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946427 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946431 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946434 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946436 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946439 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946442 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946444 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946447 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946449 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.949565 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946452 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946454 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946457 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946460 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946462 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946465 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946467 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946470 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946472 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946475 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946478 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946482 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946485 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946487 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946490 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946492 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946495 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946498 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946501 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.950061 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946504 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946506 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946509 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946511 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946514 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946516 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946521 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946525 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946529 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946532 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946535 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946538 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946541 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946544 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946547 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946550 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946553 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946555 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946558 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.950512 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946561 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946564 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946566 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946569 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946572 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946575 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946578 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946581 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946583 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946586 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946588 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946591 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946594 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946596 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946598 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946601 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946603 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946606 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946608 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946611 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.950987 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946614 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946616 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946619 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946621 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946623 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946626 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946629 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946632 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946634 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946637 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946639 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946642 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946644 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946648 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946651 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946653 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946656 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946660 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946663 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946665 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.951461 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946668 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946670 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946673 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946675 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946678 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946681 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946684 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946688 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.946691 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946792 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946802 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946808 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946813 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946818 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946822 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946826 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946830 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946833 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946836 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946839 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946842 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946845 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 01:15:56.952003 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946848 2576 flags.go:64] FLAG: --cgroup-root="" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946851 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946854 2576 flags.go:64] FLAG: --client-ca-file="" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946858 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946862 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946866 2576 flags.go:64] FLAG: --cluster-domain="" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946870 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946873 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946876 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946880 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946884 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946887 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946891 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946894 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946897 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946900 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946903 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946906 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946909 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946913 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946916 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946919 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946923 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946926 2576 flags.go:64] FLAG: --enable-server="true" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946929 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 01:15:56.952534 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946934 2576 flags.go:64] FLAG: --event-burst="100" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946937 2576 flags.go:64] FLAG: --event-qps="50" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946940 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946943 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946946 2576 flags.go:64] FLAG: --eviction-hard="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946949 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946952 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946955 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946958 2576 flags.go:64] FLAG: --eviction-soft="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946961 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946965 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946968 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946971 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946974 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946977 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946980 2576 flags.go:64] FLAG: --feature-gates="" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946983 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946986 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946989 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946993 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946996 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.946998 2576 flags.go:64] FLAG: --help="false" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947001 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-129-196.ec2.internal" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947004 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 01:15:56.953209 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947007 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947010 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947014 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947017 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947020 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947022 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947025 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947028 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947032 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947035 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947037 2576 flags.go:64] FLAG: --kube-reserved="" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947040 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947043 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947046 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947049 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947052 2576 flags.go:64] FLAG: --lock-file="" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947054 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947057 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947061 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947066 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947069 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947073 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947076 2576 flags.go:64] FLAG: --logging-format="text" Jun 09 01:15:56.953874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947079 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947082 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947085 2576 flags.go:64] FLAG: --manifest-url="" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947089 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947093 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947096 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947100 2576 flags.go:64] FLAG: --max-pods="110" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947103 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947106 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947109 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947112 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947115 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947118 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947121 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947128 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947131 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947135 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947138 2576 flags.go:64] FLAG: --pod-cidr="" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947141 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947146 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947149 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947152 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947155 2576 flags.go:64] FLAG: --port="10250" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947158 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 01:15:56.954438 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947161 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077a2a75cead0a179" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947164 2576 flags.go:64] FLAG: --qos-reserved="" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947167 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947170 2576 flags.go:64] FLAG: --register-node="true" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947174 2576 flags.go:64] FLAG: --register-with-taints="" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947178 2576 flags.go:64] FLAG: --registry-burst="10" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947182 2576 flags.go:64] FLAG: --registry-qps="5" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947185 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947187 2576 flags.go:64] FLAG: --reserved-memory="" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947191 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947194 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947197 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947200 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947203 2576 flags.go:64] FLAG: --runonce="false" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947205 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947208 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947211 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947214 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947217 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947220 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947223 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947226 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947228 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947231 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947234 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947237 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 01:15:56.955069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947240 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947243 2576 flags.go:64] FLAG: --system-cgroups="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947246 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947251 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947253 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947256 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947260 2576 flags.go:64] FLAG: --tls-min-version="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947263 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947265 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947268 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947271 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947274 2576 flags.go:64] FLAG: --v="2" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947279 2576 flags.go:64] FLAG: --version="false" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947284 2576 flags.go:64] FLAG: --vmodule="" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947287 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.947291 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947403 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947408 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947412 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947415 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947418 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947421 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947423 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.955697 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947426 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947430 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947434 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947437 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947442 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947445 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947447 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947450 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947453 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947456 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947458 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947461 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947464 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947467 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947469 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947472 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947475 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947477 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947479 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.956281 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947482 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947485 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947489 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947492 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947494 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947497 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947499 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947502 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947505 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947507 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947510 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947512 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947515 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947517 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947520 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947523 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947525 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947528 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947531 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947533 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.956749 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947536 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947538 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947541 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947544 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947546 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947549 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947552 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947555 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947558 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947561 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947564 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947567 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947569 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947572 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947576 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947578 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947581 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947583 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947586 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.957276 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947588 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947591 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947593 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947596 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947598 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947601 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947603 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947606 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947608 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947611 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947613 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947618 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947621 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947623 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947626 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947628 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947630 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947633 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.957785 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947636 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947638 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947641 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947643 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947646 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947648 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947653 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947655 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947659 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947662 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947665 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947667 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947670 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947672 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.947675 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.958268 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.948205 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.954980 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.954998 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.955017 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.955022 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955088 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955093 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955096 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955099 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955104 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955108 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955111 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955114 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955117 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955120 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955123 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955126 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955128 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955131 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.958636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955134 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955136 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955139 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955142 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955145 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955148 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955150 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955153 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955155 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955158 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955161 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955163 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955165 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955169 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955171 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955182 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955187 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955190 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955193 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.959126 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955195 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955198 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955200 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955203 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955205 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955208 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955210 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955213 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955215 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955218 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955220 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955223 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955226 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955228 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955230 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955233 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955235 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955239 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955243 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955246 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.959624 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955249 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955251 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955254 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955256 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955259 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955261 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955264 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955267 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955275 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955278 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955281 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955283 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955286 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955288 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955291 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955293 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955296 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955298 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955301 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.960154 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955303 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955306 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955308 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955311 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955313 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955315 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955318 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955321 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955323 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955326 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955328 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955331 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955333 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955336 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955338 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955340 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955343 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955345 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955348 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955350 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.960636 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955354 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955356 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955365 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955367 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955371 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955375 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.955380 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955538 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955544 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955547 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955549 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955552 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955555 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955558 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955561 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:56.961144 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955564 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955567 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955570 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955573 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955576 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955578 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955581 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955584 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955587 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955589 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955592 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955594 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955597 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955600 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955602 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955605 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955607 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955610 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955613 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:56.961511 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955624 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955627 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955629 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955632 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955634 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955637 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955639 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955642 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955644 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955647 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955649 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955652 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955654 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955659 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955662 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955664 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955667 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955670 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955672 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:56.962025 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955675 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955677 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955680 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955682 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955684 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955687 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955690 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955692 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955696 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955700 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955703 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955706 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955709 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955717 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955720 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955723 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955725 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955728 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955730 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:56.962593 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955733 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955736 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955738 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955741 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955743 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955746 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955748 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955751 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955753 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955768 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955770 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955773 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955775 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955778 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955781 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955784 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955786 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955790 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955794 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:56.963320 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955798 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955801 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955803 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955807 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955809 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955812 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955814 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955817 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955827 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955830 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955832 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955835 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:56.955837 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.955843 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:56.964129 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.955954 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 01:15:56.964652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.957921 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 01:15:56.964652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.959152 2576 server.go:1019] "Starting client certificate rotation" Jun 09 01:15:56.964652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.959247 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 01:15:56.964652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.959283 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 01:15:56.964652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.961845 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 01:15:56.967146 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.967125 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 01:15:56.979972 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.979952 2576 log.go:25] "Validated CRI v1 runtime API" Jun 09 01:15:56.982014 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.981999 2576 log.go:25] "Validated CRI v1 image API" Jun 09 01:15:56.982783 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.982750 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 01:15:56.985309 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.985291 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94370361-f6af-4725-b2c6-353cbc764a34:/dev/nvme0n1p3 c5ec63f2-715f-4fd5-bc67-efbcbd662aa0:/dev/nvme0n1p4] Jun 09 01:15:56.985367 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.985309 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 01:15:56.989107 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.989092 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 01:15:56.990372 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.990268 2576 manager.go:216] Machine: {Timestamp:2026-06-09 01:15:56.988946055 +0000 UTC m=+0.342258390 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098249 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c90f944e1969146e167001e51ce4b SystemUUID:ec2c90f9-44e1-9691-46e1-67001e51ce4b BootID:fc1d22b8-3b81-40e9-9557-89225ceb8677 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:60:8b:39:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:60:8b:39:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:0e:a9:d8:ce:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 01:15:56.990372 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.990370 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 01:15:56.990472 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.990440 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 01:15:56.992795 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.992752 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 01:15:56.992940 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.992799 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 01:15:56.993868 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.993858 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 01:15:56.993900 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.993871 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 01:15:56.993900 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.993878 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 01:15:56.994668 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.994658 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 01:15:56.995504 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.995495 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 01:15:56.998218 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998207 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 01:15:56.998351 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998341 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 01:15:56.998386 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998383 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 09 01:15:56.998414 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998395 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 01:15:56.998414 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998408 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 01:15:56.998481 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998420 2576 kubelet.go:398] "Adding apiserver pod source" Jun 09 01:15:56.998481 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998428 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 01:15:56.998978 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998819 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 01:15:56.998978 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:56.998836 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 01:15:57.001041 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.001024 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 01:15:57.002941 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.002914 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 01:15:57.003005 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.002967 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 01:15:57.003946 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003921 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 01:15:57.003946 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003946 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003956 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003965 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003978 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003987 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.003999 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.004013 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.004025 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.004034 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.004058 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 01:15:57.004069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.004067 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 01:15:57.005106 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.005090 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 01:15:57.005167 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.005138 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 01:15:57.007475 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.007447 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 01:15:57.007607 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.007591 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 01:15:57.007658 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.007610 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 01:15:57.008515 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.008499 2576 server.go:1268] "Started kubelet" Jun 09 01:15:57.008619 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.008564 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 01:15:57.008678 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.008604 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 01:15:57.008718 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.008678 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 01:15:57.009519 ip-10-0-129-196 systemd[1]: Started Kubernetes Kubelet. Jun 09 01:15:57.010223 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.010208 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 09 01:15:57.010285 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.010254 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 01:15:57.014140 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.014122 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2twpc" Jun 09 01:15:57.014898 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.013931 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-196.ec2.internal.18b744bd30e9fce1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-196.ec2.internal,UID:ip-10-0-129-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-196.ec2.internal,},FirstTimestamp:2026-06-09 01:15:57.008469217 +0000 UTC m=+0.361781533,LastTimestamp:2026-06-09 01:15:57.008469217 +0000 UTC m=+0.361781533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-196.ec2.internal,}" Jun 09 01:15:57.015908 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.015891 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 01:15:57.016000 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.015920 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 01:15:57.016000 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.015984 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.016242 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.016222 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 01:15:57.016422 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016401 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 01:15:57.016422 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016402 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 01:15:57.016575 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016432 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 01:15:57.016685 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016659 2576 factory.go:55] Registering systemd factory Jun 09 01:15:57.016741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016688 2576 factory.go:223] Registration of the systemd container factory successfully Jun 09 01:15:57.016903 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016890 2576 factory.go:153] Registering CRI-O factory Jun 09 01:15:57.016903 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016905 2576 factory.go:223] Registration of the crio container factory successfully Jun 09 01:15:57.017051 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016957 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 01:15:57.017051 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.016982 2576 factory.go:103] Registering Raw factory Jun 09 01:15:57.017051 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.017000 2576 manager.go:1196] Started watching for new ooms in manager Jun 09 01:15:57.017592 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.017579 2576 manager.go:349] Starting recovery of all containers Jun 09 01:15:57.017664 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.017646 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 09 01:15:57.018052 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.018026 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 09 01:15:57.018918 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.018896 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2twpc" Jun 09 01:15:57.025210 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.025054 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:57.027362 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.027296 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-196.ec2.internal\" not found" node="ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.027817 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.027801 2576 manager.go:354] Recovery completed Jun 09 01:15:57.029778 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.029742 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 01:15:57.032640 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.032627 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.036349 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036333 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.036422 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036365 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.036422 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036379 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.036860 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036847 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 01:15:57.036910 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036861 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 01:15:57.036910 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036880 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 01:15:57.036988 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.036912 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.037826 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.037813 2576 policy_none.go:49] "None policy: Start" Jun 09 01:15:57.037879 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.037827 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 01:15:57.037879 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.037837 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 01:15:57.038488 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.038475 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.038536 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.038497 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.038536 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.038507 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.038791 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.038775 2576 policy_none.go:47] "Start" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.079585 2576 manager.go:337] "Starting Device Plugin manager" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.079622 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.079642 2576 server.go:87] "Starting device plugin registration server" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.079892 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.079905 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.079970 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.080047 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.080067 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.080683 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.080745 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.089706 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.090906 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.090949 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.090971 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 01:15:57.092205 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.091015 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 01:15:57.092866 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.092736 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:57.180013 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.179971 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.180878 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.180862 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.180945 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.180896 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.180945 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.180908 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.180945 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.180936 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.188027 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.188011 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.188130 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.188035 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-196.ec2.internal\": node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.191124 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.191076 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal"] Jun 09 01:15:57.191200 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.191142 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.193031 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.193018 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.193115 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.193044 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.193115 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.193055 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.194370 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.194358 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.194482 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.194469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.194549 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.194505 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.195502 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195483 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.195595 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195510 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.195595 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195524 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.195595 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195587 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.195700 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195615 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.195700 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.195626 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.196562 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.196546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.196614 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.196573 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:57.198351 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.198335 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:57.198439 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.198365 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:57.198439 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.198377 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:57.202307 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.202288 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.212283 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.212266 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-196.ec2.internal\" not found" node="ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.215559 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.215542 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-196.ec2.internal\" not found" node="ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.219701 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.219685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d5aa0b4a4d5291d38de39444ef485cd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-196.ec2.internal\" (UID: \"6d5aa0b4a4d5291d38de39444ef485cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.219766 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.219708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.219766 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.219725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.303294 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.303271 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.320463 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.320571 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.320571 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d5aa0b4a4d5291d38de39444ef485cd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-196.ec2.internal\" (UID: \"6d5aa0b4a4d5291d38de39444ef485cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.320571 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.320571 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d5aa0b4a4d5291d38de39444ef485cd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-196.ec2.internal\" (UID: \"6d5aa0b4a4d5291d38de39444ef485cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.320571 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.320552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d437116012331445dda0cf7ec75b772-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal\" (UID: \"5d437116012331445dda0cf7ec75b772\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.403618 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.403582 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.504387 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.504315 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.516489 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.516469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.518781 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.518748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:57.605024 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.604991 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.705565 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.705533 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.806068 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.805990 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.906530 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:57.906497 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:57.956613 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.956579 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:57.959092 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.959074 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 01:15:57.959194 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.959177 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:57.959251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.959223 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:57.959251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:57.959226 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:58.007522 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:58.007501 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-196.ec2.internal\" not found" Jun 09 01:15:58.021568 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.021542 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 01:10:57 +0000 UTC" deadline="2027-12-11 00:29:06.581555415 +0000 UTC" Jun 09 01:15:58.021568 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.021566 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13199h13m8.559992563s" Jun 09 01:15:58.088037 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.087990 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:58.116152 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.116132 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" Jun 09 01:15:58.127595 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.127575 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 01:15:58.128728 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.128713 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" Jun 09 01:15:58.138331 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.138310 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 01:15:58.173382 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:58.173353 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d437116012331445dda0cf7ec75b772.slice/crio-b50cd94c2c1d098640eb8318e4cda27cf76cdd3fff073db608027eea79722e84 WatchSource:0}: Error finding container b50cd94c2c1d098640eb8318e4cda27cf76cdd3fff073db608027eea79722e84: Status 404 returned error can't find the container with id b50cd94c2c1d098640eb8318e4cda27cf76cdd3fff073db608027eea79722e84 Jun 09 01:15:58.173643 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:15:58.173629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5aa0b4a4d5291d38de39444ef485cd.slice/crio-9dd13767ca8fff47c4bebe342f0ff39f18a571ea4e072162797d8153990eb64a WatchSource:0}: Error finding container 9dd13767ca8fff47c4bebe342f0ff39f18a571ea4e072162797d8153990eb64a: Status 404 returned error can't find the container with id 9dd13767ca8fff47c4bebe342f0ff39f18a571ea4e072162797d8153990eb64a Jun 09 01:15:58.180624 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.180606 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:15:58.999490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:58.999458 2576 apiserver.go:52] "Watching apiserver" Jun 09 01:15:59.006704 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.006680 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 01:15:59.007158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.007132 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-bzlf9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal","openshift-multus/multus-additional-cni-plugins-22w6m","openshift-multus/multus-h8nn4","openshift-network-operator/iptables-alerter-nbrmj","kube-system/global-pull-secret-syncer-d2dqj","kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx","openshift-cluster-node-tuning-operator/tuned-mm65c","openshift-image-registry/node-ca-998pt","openshift-multus/network-metrics-daemon-89hqz","openshift-network-diagnostics/network-check-target-5wr2g","openshift-ovn-kubernetes/ovnkube-node-vbcbf","kube-system/konnectivity-agent-7l5q6"] Jun 09 01:15:59.009865 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.009843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.012170 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.012140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.013327 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.013193 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b95r4\"" Jun 09 01:15:59.013419 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.013345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 01:15:59.013419 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.013375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.013524 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.013455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.014331 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.014836 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014816 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.014937 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014872 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.014937 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014916 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 01:15:59.014937 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014926 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 01:15:59.015126 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014987 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 01:15:59.015126 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.014879 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dgg5w\"" Jun 09 01:15:59.015326 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.015306 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 01:15:59.016351 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.016331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mz8kl\"" Jun 09 01:15:59.016622 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.016593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 01:15:59.016731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.016712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 01:15:59.016874 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.016802 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 01:15:59.016988 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.016966 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.017077 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.017060 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.017245 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.017223 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 01:15:59.017360 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.017257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.019052 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.018668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.019526 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.019506 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 01:15:59.019633 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.019618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9574\"" Jun 09 01:15:59.020869 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.020850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.020966 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.020938 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:15:59.021049 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.021032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 01:15:59.021200 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.021180 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gx2h9\"" Jun 09 01:15:59.021276 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.021258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.021315 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.021184 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.023932 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.023457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.026143 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.026122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-949d7\"" Jun 09 01:15:59.026383 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.026366 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.026592 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.026580 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.026913 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.026896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.027649 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-log-socket\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.027735 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.027735 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cnibin\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.028494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-os-release\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.028494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2f47376-5df3-4985-b0c6-c990a3c55be7-serviceca\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.028494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.027970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-config\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.028659 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-system-cni-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.028842 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-os-release\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.028842 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.028842 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-cni-binary-copy\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029022 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-kubelet\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029022 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-var-lib-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029022 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-netd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029022 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.028942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-script-lib\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029022 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-hostroot\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-daemon-config\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xjk\" (UniqueName: \"kubernetes.io/projected/78590a40-2814-4aa6-b641-5ebe8fef8959-kube-api-access-27xjk\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fef7f16-0e43-449f-bbe7-2248ea54110e-iptables-alerter-script\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hmw\" (UniqueName: \"kubernetes.io/projected/5fef7f16-0e43-449f-bbe7-2248ea54110e-kube-api-access-42hmw\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-systemd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-ovn\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-node-log\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqg72\" (UniqueName: \"kubernetes.io/projected/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-kube-api-access-lqg72\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-system-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wfwj6\"" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgkjb\" (UniqueName: \"kubernetes.io/projected/0e999ebe-4200-48d6-a68e-d8d55a859c39-kube-api-access-tgkjb\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-k8s-cni-cncf-io\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.029572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-bin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-multus\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-multus-certs\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfdq\" (UniqueName: \"kubernetes.io/projected/a2f47376-5df3-4985-b0c6-c990a3c55be7-kube-api-access-crfdq\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-bin\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-env-overrides\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovn-node-metrics-cert\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-netns\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-conf-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-etc-kubernetes\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.029978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2f47376-5df3-4985-b0c6-c990a3c55be7-host\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-kubelet\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-systemd-units\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030087 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-slash\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-cnibin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-socket-dir-parent\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fef7f16-0e43-449f-bbe7-2248ea54110e-host-slash\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030884 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-netns\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-etc-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.030995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.030963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.032294 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.032172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.032688 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.032672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.032781 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.032721 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lw9cc\"" Jun 09 01:15:59.032847 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.032809 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.032987 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.032920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 01:15:59.034414 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.034361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 01:15:59.034476 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.034450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.034543 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.034516 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:15:59.034908 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.034790 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 01:15:59.034908 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.034893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-stcvq\"" Jun 09 01:15:59.036870 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.036837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:15:59.036938 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.036882 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:15:59.050491 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.050470 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k24p4" Jun 09 01:15:59.058796 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.058497 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k24p4" Jun 09 01:15:59.095267 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.095220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" event={"ID":"6d5aa0b4a4d5291d38de39444ef485cd","Type":"ContainerStarted","Data":"9dd13767ca8fff47c4bebe342f0ff39f18a571ea4e072162797d8153990eb64a"} Jun 09 01:15:59.096313 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.096289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" event={"ID":"5d437116012331445dda0cf7ec75b772","Type":"ContainerStarted","Data":"b50cd94c2c1d098640eb8318e4cda27cf76cdd3fff073db608027eea79722e84"} Jun 09 01:15:59.117421 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.117400 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 01:15:59.131262 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.131395 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqg72\" (UniqueName: \"kubernetes.io/projected/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-kube-api-access-lqg72\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.131395 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.131395 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-system-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131549 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-multus\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131549 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-multus-certs\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131549 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-system-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-multus-certs\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgkjb\" (UniqueName: \"kubernetes.io/projected/0e999ebe-4200-48d6-a68e-d8d55a859c39-kube-api-access-tgkjb\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-multus\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-k8s-cni-cncf-io\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.131672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfdq\" (UniqueName: \"kubernetes.io/projected/a2f47376-5df3-4985-b0c6-c990a3c55be7-kube-api-access-crfdq\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-netns\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-conf-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-etc-kubernetes\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-k8s-cni-cncf-io\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fef7f16-0e43-449f-bbe7-2248ea54110e-host-slash\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-host\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-conf-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fef7f16-0e43-449f-bbe7-2248ea54110e-host-slash\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-run-netns\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-etc-kubernetes\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdz5\" (UniqueName: \"kubernetes.io/projected/8a1be551-82d0-4400-bae3-7d50b6c42a2d-kube-api-access-jrdz5\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-systemd-units\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.131999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-cnibin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-socket-dir-parent\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132029 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-systemd-units\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-sys\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5snw8\" (UniqueName: \"kubernetes.io/projected/469e649f-3a27-4ccf-93c3-8bc1398f1136-kube-api-access-5snw8\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-socket-dir-parent\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-socket-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-cnibin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-device-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-netns\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-os-release\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-system-cni-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-os-release\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132302 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-run-netns\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-cni-binary-copy\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-os-release\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-system-cni-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.132832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-kubelet\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-kubelet\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hmw\" (UniqueName: \"kubernetes.io/projected/5fef7f16-0e43-449f-bbe7-2248ea54110e-kube-api-access-42hmw\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-os-release\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-cni-dir\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysconfig\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-netd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-script-lib\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-netd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-daemon-config\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xjk\" (UniqueName: \"kubernetes.io/projected/78590a40-2814-4aa6-b641-5ebe8fef8959-kube-api-access-27xjk\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-kubernetes\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-run\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-tmp\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-systemd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.133528 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-ovn\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-node-log\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-systemd\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-bin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-modprobe-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-lib-modules\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-cni-binary-copy\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-tuned\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcr4\" (UniqueName: \"kubernetes.io/projected/74e618cf-9337-4448-9b3f-2cac9e2bfecc-kube-api-access-6kcr4\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-node-log\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-host-var-lib-cni-bin\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-systemd\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-run-ovn\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78590a40-2814-4aa6-b641-5ebe8fef8959-multus-daemon-config\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1cf71f-8c56-4267-8075-1942388c153c-agent-certs\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-sys-fs\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.134297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1be551-82d0-4400-bae3-7d50b6c42a2d-tmp-dir\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.132942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-bin\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-env-overrides\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovn-node-metrics-cert\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-cni-bin\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2f47376-5df3-4985-b0c6-c990a3c55be7-host\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-kubelet\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-kubelet\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2f47376-5df3-4985-b0c6-c990a3c55be7-host\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-slash\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-kubelet-config\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-slash\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133783 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 01:15:59.135103 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-etc-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-script-lib\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-etc-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-conf\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-log-socket\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-env-overrides\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-log-socket\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.133998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cnibin\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cnibin\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-dbus\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd9jp\" (UniqueName: \"kubernetes.io/projected/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kube-api-access-sd9jp\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2f47376-5df3-4985-b0c6-c990a3c55be7-serviceca\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-config\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.135597 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-registration-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-var-lib-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-hostroot\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fef7f16-0e43-449f-bbe7-2248ea54110e-iptables-alerter-script\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-var-lib-kubelet\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1cf71f-8c56-4267-8075-1942388c153c-konnectivity-ca\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a1be551-82d0-4400-bae3-7d50b6c42a2d-hosts-file\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2f47376-5df3-4985-b0c6-c990a3c55be7-serviceca\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovnkube-config\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78590a40-2814-4aa6-b641-5ebe8fef8959-hostroot\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.134615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e999ebe-4200-48d6-a68e-d8d55a859c39-var-lib-openvswitch\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.136158 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.135034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fef7f16-0e43-449f-bbe7-2248ea54110e-iptables-alerter-script\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.137141 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.137119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e999ebe-4200-48d6-a68e-d8d55a859c39-ovn-node-metrics-cert\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.145477 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.145420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqg72\" (UniqueName: \"kubernetes.io/projected/d60e6bc1-55de-4238-9ca5-cbaba16d5c37-kube-api-access-lqg72\") pod \"multus-additional-cni-plugins-22w6m\" (UID: \"d60e6bc1-55de-4238-9ca5-cbaba16d5c37\") " pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.145661 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.145639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hmw\" (UniqueName: \"kubernetes.io/projected/5fef7f16-0e43-449f-bbe7-2248ea54110e-kube-api-access-42hmw\") pod \"iptables-alerter-nbrmj\" (UID: \"5fef7f16-0e43-449f-bbe7-2248ea54110e\") " pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.145751 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.145728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfdq\" (UniqueName: \"kubernetes.io/projected/a2f47376-5df3-4985-b0c6-c990a3c55be7-kube-api-access-crfdq\") pod \"node-ca-998pt\" (UID: \"a2f47376-5df3-4985-b0c6-c990a3c55be7\") " pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.145837 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.145816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xjk\" (UniqueName: \"kubernetes.io/projected/78590a40-2814-4aa6-b641-5ebe8fef8959-kube-api-access-27xjk\") pod \"multus-h8nn4\" (UID: \"78590a40-2814-4aa6-b641-5ebe8fef8959\") " pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.146177 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.146161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgkjb\" (UniqueName: \"kubernetes.io/projected/0e999ebe-4200-48d6-a68e-d8d55a859c39-kube-api-access-tgkjb\") pod \"ovnkube-node-vbcbf\" (UID: \"0e999ebe-4200-48d6-a68e-d8d55a859c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.234610 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-host\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdz5\" (UniqueName: \"kubernetes.io/projected/8a1be551-82d0-4400-bae3-7d50b6c42a2d-kube-api-access-jrdz5\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-sys\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5snw8\" (UniqueName: \"kubernetes.io/projected/469e649f-3a27-4ccf-93c3-8bc1398f1136-kube-api-access-5snw8\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-host\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-socket-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-device-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.234808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-sys\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysconfig\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-socket-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-kubernetes\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.234875 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-device-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-run\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-kubernetes\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysconfig\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.234948 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:15:59.734924344 +0000 UTC m=+3.088236648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-tmp\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.234986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-run\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-systemd\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-modprobe-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-lib-modules\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.235081 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:59.235234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-tuned\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-systemd\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcr4\" (UniqueName: \"kubernetes.io/projected/74e618cf-9337-4448-9b3f-2cac9e2bfecc-kube-api-access-6kcr4\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.235139 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:59.735122042 +0000 UTC m=+3.088434349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-modprobe-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1cf71f-8c56-4267-8075-1942388c153c-agent-certs\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-sys-fs\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-lib-modules\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1be551-82d0-4400-bae3-7d50b6c42a2d-tmp-dir\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-kubelet-config\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-conf\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-dbus\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd9jp\" (UniqueName: \"kubernetes.io/projected/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kube-api-access-sd9jp\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-kubelet-config\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.236061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-registration-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-var-lib-kubelet\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-registration-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1cf71f-8c56-4267-8075-1942388c153c-konnectivity-ca\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a1be551-82d0-4400-bae3-7d50b6c42a2d-hosts-file\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-conf\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-sysctl-d\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235647 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a1be551-82d0-4400-bae3-7d50b6c42a2d-hosts-file\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-sys-fs\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-dbus\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e618cf-9337-4448-9b3f-2cac9e2bfecc-var-lib-kubelet\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.235878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1be551-82d0-4400-bae3-7d50b6c42a2d-tmp-dir\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.236915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.236193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1cf71f-8c56-4267-8075-1942388c153c-konnectivity-ca\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.237951 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.237929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-tmp\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.238042 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.237964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e618cf-9337-4448-9b3f-2cac9e2bfecc-etc-tuned\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.238042 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.238001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1cf71f-8c56-4267-8075-1942388c153c-agent-certs\") pod \"konnectivity-agent-7l5q6\" (UID: \"7f1cf71f-8c56-4267-8075-1942388c153c\") " pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.247563 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.247512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdz5\" (UniqueName: \"kubernetes.io/projected/8a1be551-82d0-4400-bae3-7d50b6c42a2d-kube-api-access-jrdz5\") pod \"node-resolver-bzlf9\" (UID: \"8a1be551-82d0-4400-bae3-7d50b6c42a2d\") " pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.247857 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.247840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcr4\" (UniqueName: \"kubernetes.io/projected/74e618cf-9337-4448-9b3f-2cac9e2bfecc-kube-api-access-6kcr4\") pod \"tuned-mm65c\" (UID: \"74e618cf-9337-4448-9b3f-2cac9e2bfecc\") " pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.250289 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.250246 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:59.250289 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.250268 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:59.250289 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.250278 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:59.250465 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.250336 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:59.750322389 +0000 UTC m=+3.103634695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:59.253402 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.253384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5snw8\" (UniqueName: \"kubernetes.io/projected/469e649f-3a27-4ccf-93c3-8bc1398f1136-kube-api-access-5snw8\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.254182 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.254166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd9jp\" (UniqueName: \"kubernetes.io/projected/2b307aba-6965-41c6-a1ee-e2ae9b0d65ac-kube-api-access-sd9jp\") pod \"aws-ebs-csi-driver-node-9bvgx\" (UID: \"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.278551 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.278527 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:59.321893 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.321861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-998pt" Jun 09 01:15:59.331535 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.331515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:15:59.337912 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.337890 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:59.340033 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.340012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-22w6m" Jun 09 01:15:59.343644 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.343620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h8nn4" Jun 09 01:15:59.352306 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.352212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbrmj" Jun 09 01:15:59.360307 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.360287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mm65c" Jun 09 01:15:59.368030 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.368003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:15:59.376627 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.376606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" Jun 09 01:15:59.382088 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.382071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bzlf9" Jun 09 01:15:59.740813 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.740731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:15:59.740813 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.740794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:15:59.741007 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.740861 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:59.741007 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.740894 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:59.741007 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.740926 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:16:00.740906444 +0000 UTC m=+4.094218753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:59.741007 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.740945 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:00.740937268 +0000 UTC m=+4.094249581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:59.841445 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:15:59.841409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:15:59.841616 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.841524 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:59.841616 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.841541 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:59.841616 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.841552 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:59.841616 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:15:59.841603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:00.841591714 +0000 UTC m=+4.194904030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:00.042369 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.042345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78590a40_2814_4aa6_b641_5ebe8fef8959.slice/crio-cbb56cab10ebacf16fd29f8b0a7d3fb475b3dbf7dcd73ce075e9f517f89a19a9 WatchSource:0}: Error finding container cbb56cab10ebacf16fd29f8b0a7d3fb475b3dbf7dcd73ce075e9f517f89a19a9: Status 404 returned error can't find the container with id cbb56cab10ebacf16fd29f8b0a7d3fb475b3dbf7dcd73ce075e9f517f89a19a9 Jun 09 01:16:00.044097 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.044070 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f47376_5df3_4985_b0c6_c990a3c55be7.slice/crio-af684cccc73a6917f6d9c27b16e1892bd5008086e0439f9dd31088995cb0e294 WatchSource:0}: Error finding container af684cccc73a6917f6d9c27b16e1892bd5008086e0439f9dd31088995cb0e294: Status 404 returned error can't find the container with id af684cccc73a6917f6d9c27b16e1892bd5008086e0439f9dd31088995cb0e294 Jun 09 01:16:00.044827 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.044741 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fef7f16_0e43_449f_bbe7_2248ea54110e.slice/crio-523e0022e2cf45a86f56629590210117637e46963758392bd02ef4daa2a0f7d1 WatchSource:0}: Error finding container 523e0022e2cf45a86f56629590210117637e46963758392bd02ef4daa2a0f7d1: Status 404 returned error can't find the container with id 523e0022e2cf45a86f56629590210117637e46963758392bd02ef4daa2a0f7d1 Jun 09 01:16:00.046467 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.046451 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:16:00.061702 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.061678 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 01:10:59 +0000 UTC" deadline="2028-03-17 02:48:20.598368846 +0000 UTC" Jun 09 01:16:00.061702 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.061702 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15529h32m20.536669198s" Jun 09 01:16:00.070808 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.070784 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1cf71f_8c56_4267_8075_1942388c153c.slice/crio-9325e7e3a29505cf0047c7199181e04397c9a54e703adb43086da54bc94cb302 WatchSource:0}: Error finding container 9325e7e3a29505cf0047c7199181e04397c9a54e703adb43086da54bc94cb302: Status 404 returned error can't find the container with id 9325e7e3a29505cf0047c7199181e04397c9a54e703adb43086da54bc94cb302 Jun 09 01:16:00.071830 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.071458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b307aba_6965_41c6_a1ee_e2ae9b0d65ac.slice/crio-c9c34af12300372155fe91f892c092538e82cfbe64914d751e56c927a81e2bde WatchSource:0}: Error finding container c9c34af12300372155fe91f892c092538e82cfbe64914d751e56c927a81e2bde: Status 404 returned error can't find the container with id c9c34af12300372155fe91f892c092538e82cfbe64914d751e56c927a81e2bde Jun 09 01:16:00.072947 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.072932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e999ebe_4200_48d6_a68e_d8d55a859c39.slice/crio-293273f41628e6a74cc277e133817b3893e01050951c75e49d5e5c3a2b89eb43 WatchSource:0}: Error finding container 293273f41628e6a74cc277e133817b3893e01050951c75e49d5e5c3a2b89eb43: Status 404 returned error can't find the container with id 293273f41628e6a74cc277e133817b3893e01050951c75e49d5e5c3a2b89eb43 Jun 09 01:16:00.074502 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.074460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e618cf_9337_4448_9b3f_2cac9e2bfecc.slice/crio-475da359490ec84b8f485595c556d0e463ca9da6f00c713ba386b62afd754721 WatchSource:0}: Error finding container 475da359490ec84b8f485595c556d0e463ca9da6f00c713ba386b62afd754721: Status 404 returned error can't find the container with id 475da359490ec84b8f485595c556d0e463ca9da6f00c713ba386b62afd754721 Jun 09 01:16:00.076367 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.076345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1be551_82d0_4400_bae3_7d50b6c42a2d.slice/crio-6c8d478006d806a87aaea886acf0fd17c074c863fc8d91fdaa8036f8b731a71f WatchSource:0}: Error finding container 6c8d478006d806a87aaea886acf0fd17c074c863fc8d91fdaa8036f8b731a71f: Status 404 returned error can't find the container with id 6c8d478006d806a87aaea886acf0fd17c074c863fc8d91fdaa8036f8b731a71f Jun 09 01:16:00.076775 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:00.076733 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60e6bc1_55de_4238_9ca5_cbaba16d5c37.slice/crio-bdbf81f216a594f8ebe2af653dded21ac736d320047b38da0a9a0d7248cb1f4c WatchSource:0}: Error finding container bdbf81f216a594f8ebe2af653dded21ac736d320047b38da0a9a0d7248cb1f4c: Status 404 returned error can't find the container with id bdbf81f216a594f8ebe2af653dded21ac736d320047b38da0a9a0d7248cb1f4c Jun 09 01:16:00.101147 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.101113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"293273f41628e6a74cc277e133817b3893e01050951c75e49d5e5c3a2b89eb43"} Jun 09 01:16:00.102081 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.102062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7l5q6" event={"ID":"7f1cf71f-8c56-4267-8075-1942388c153c","Type":"ContainerStarted","Data":"9325e7e3a29505cf0047c7199181e04397c9a54e703adb43086da54bc94cb302"} Jun 09 01:16:00.108949 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.108924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-998pt" event={"ID":"a2f47376-5df3-4985-b0c6-c990a3c55be7","Type":"ContainerStarted","Data":"af684cccc73a6917f6d9c27b16e1892bd5008086e0439f9dd31088995cb0e294"} Jun 09 01:16:00.111335 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.111312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h8nn4" event={"ID":"78590a40-2814-4aa6-b641-5ebe8fef8959","Type":"ContainerStarted","Data":"cbb56cab10ebacf16fd29f8b0a7d3fb475b3dbf7dcd73ce075e9f517f89a19a9"} Jun 09 01:16:00.115675 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.115546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bzlf9" event={"ID":"8a1be551-82d0-4400-bae3-7d50b6c42a2d","Type":"ContainerStarted","Data":"6c8d478006d806a87aaea886acf0fd17c074c863fc8d91fdaa8036f8b731a71f"} Jun 09 01:16:00.116524 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.116505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mm65c" event={"ID":"74e618cf-9337-4448-9b3f-2cac9e2bfecc","Type":"ContainerStarted","Data":"475da359490ec84b8f485595c556d0e463ca9da6f00c713ba386b62afd754721"} Jun 09 01:16:00.117444 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.117423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" event={"ID":"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac","Type":"ContainerStarted","Data":"c9c34af12300372155fe91f892c092538e82cfbe64914d751e56c927a81e2bde"} Jun 09 01:16:00.118555 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.118536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbrmj" event={"ID":"5fef7f16-0e43-449f-bbe7-2248ea54110e","Type":"ContainerStarted","Data":"523e0022e2cf45a86f56629590210117637e46963758392bd02ef4daa2a0f7d1"} Jun 09 01:16:00.119429 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.119407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerStarted","Data":"bdbf81f216a594f8ebe2af653dded21ac736d320047b38da0a9a0d7248cb1f4c"} Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.749280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.749333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.749449 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.749511 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:02.749492137 +0000 UTC m=+6.102804444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.749917 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:00.750046 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.749967 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:16:02.749951754 +0000 UTC m=+6.103264063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:00.850516 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:00.849949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:00.850516 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.850111 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:00.850516 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.850132 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:00.850516 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.850144 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:00.850516 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:00.850197 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:02.850181066 +0000 UTC m=+6.203493383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:01.062023 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.061908 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 01:10:59 +0000 UTC" deadline="2027-11-26 15:08:23.453195421 +0000 UTC" Jun 09 01:16:01.062023 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.061969 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12853h52m22.391230416s" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.094303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:01.094418 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.094826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:01.094943 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.095010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:01.095141 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:01.095094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:01.133707 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.133673 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d437116012331445dda0cf7ec75b772" containerID="74be2bcf781b4296c4cd7ed5f2672abebb1c77d6a085362ca7557ad82394f83c" exitCode=0 Jun 09 01:16:01.134030 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.133970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" event={"ID":"5d437116012331445dda0cf7ec75b772","Type":"ContainerDied","Data":"74be2bcf781b4296c4cd7ed5f2672abebb1c77d6a085362ca7557ad82394f83c"} Jun 09 01:16:01.142927 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:01.142506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" event={"ID":"6d5aa0b4a4d5291d38de39444ef485cd","Type":"ContainerStarted","Data":"02fb8d762bd395147cb98c47f8057e22626a28dd513c4cfc111e71a6ad57f85a"} Jun 09 01:16:02.163055 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:02.162953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" event={"ID":"5d437116012331445dda0cf7ec75b772","Type":"ContainerStarted","Data":"821fc78d1d14109cf235d0e51493a7d0f37b39c40d2310361d72d1f474e19b7f"} Jun 09 01:16:02.180788 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:02.179546 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-196.ec2.internal" podStartSLOduration=4.179526054 podStartE2EDuration="4.179526054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:01.16370619 +0000 UTC m=+4.517018516" watchObservedRunningTime="2026-06-09 01:16:02.179526054 +0000 UTC m=+5.532838379" Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:02.763539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:02.763593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.763708 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.763785 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:06.763753332 +0000 UTC m=+10.117065635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.763708 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:02.764155 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.763833 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:16:06.763820657 +0000 UTC m=+10.117132968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:02.864472 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:02.864438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:02.864659 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.864639 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:02.864749 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.864666 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:02.864749 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.864679 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:02.864749 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:02.864737 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:06.864716938 +0000 UTC m=+10.218029262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:03.091514 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:03.091448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:03.091657 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:03.091560 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:03.091876 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:03.091857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:03.091971 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:03.091954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:03.092023 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:03.092012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:03.092082 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:03.092068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:05.092572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:05.092539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:05.093047 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:05.092573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:05.093047 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:05.092662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:05.093047 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:05.092678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:05.093047 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:05.092834 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:05.093047 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:05.092990 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:06.800079 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:06.800043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:06.800460 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:06.800097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:06.800460 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.800189 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:06.800460 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.800246 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:14.800227634 +0000 UTC m=+18.153539962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:06.800460 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.800189 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:06.800460 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.800333 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:16:14.800317679 +0000 UTC m=+18.153629994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:06.900645 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:06.900574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:06.900837 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.900721 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:06.900837 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.900740 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:06.900837 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.900750 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:06.900837 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:06.900819 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:14.900800141 +0000 UTC m=+18.254112446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:07.094596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:07.094521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:07.094746 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:07.094621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:07.094746 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:07.094679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:07.094875 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:07.094800 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:07.094875 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:07.094862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:07.094985 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:07.094946 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:09.091731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:09.091886 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:09.092240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:09.092329 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:09.092377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:09.092488 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:09.092452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:11.091728 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:11.091693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:11.092151 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:11.091703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:11.092151 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:11.091709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:11.095158 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:11.092248 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:11.095158 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:11.092354 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:11.095158 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:11.092488 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:13.091793 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:13.091739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:13.092386 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:13.091739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:13.092386 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:13.091898 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:13.092386 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:13.091746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:13.092386 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:13.091969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:13.092386 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:13.092054 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:14.859349 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:14.859305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:14.859832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:14.859357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:14.859832 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.859464 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:14.859832 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.859483 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:14.859832 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.859533 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:16:30.859514535 +0000 UTC m=+34.212826856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:14.859832 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.859549 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:30.859541622 +0000 UTC m=+34.212853928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:14.960672 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:14.960632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:14.960875 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.960794 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:14.960875 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.960814 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:14.960875 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.960827 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:14.961034 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:14.960882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:30.960869416 +0000 UTC m=+34.314181717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:15.091486 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:15.091162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:15.091486 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:15.091192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:15.091486 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:15.091162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:15.091486 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:15.091301 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:15.091486 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:15.091440 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:15.091846 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:15.091512 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:17.092612 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:17.092523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:17.093061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:17.092615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:17.093061 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:17.092712 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:17.093061 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:17.092734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:17.093061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:17.092804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:17.093061 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:17.092897 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:19.091659 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.091422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:19.092217 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.091440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:19.092217 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.091440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:19.092217 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:19.091800 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:19.092217 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:19.091846 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:19.092217 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:19.091939 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:19.196930 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.196749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mm65c" event={"ID":"74e618cf-9337-4448-9b3f-2cac9e2bfecc","Type":"ContainerStarted","Data":"aec9dba212cf724cd2bea93e73f4af005592c5b8b2dbeec61106a53c31c60f31"} Jun 09 01:16:19.198434 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.198412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" event={"ID":"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac","Type":"ContainerStarted","Data":"c18fa7e12d3c649c3bcd35a81d0b95e4591d2acf06e86806284c10f71ca48bb9"} Jun 09 01:16:19.200030 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.200009 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="3b5b2e3cbb5a1f32d21bb85504954546131f1f0aaf37f56763edb2dae4960f4d" exitCode=0 Jun 09 01:16:19.200114 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.200073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"3b5b2e3cbb5a1f32d21bb85504954546131f1f0aaf37f56763edb2dae4960f4d"} Jun 09 01:16:19.202171 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.202148 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:16:19.202521 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.202501 2576 generic.go:356] "Generic (PLEG): container finished" podID="0e999ebe-4200-48d6-a68e-d8d55a859c39" containerID="a352816443d627ae947de40e5c2626836325a5d4155969371b2f040d5f1e9937" exitCode=1 Jun 09 01:16:19.202612 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.202526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerDied","Data":"a352816443d627ae947de40e5c2626836325a5d4155969371b2f040d5f1e9937"} Jun 09 01:16:19.202612 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.202602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"b6d875c08bef2d04c39fb9c041e5ed29d9c654827b0ec8204a658632f0096ca3"} Jun 09 01:16:19.204285 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.204268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7l5q6" event={"ID":"7f1cf71f-8c56-4267-8075-1942388c153c","Type":"ContainerStarted","Data":"21ee7c4a43bb30072bb14244ecf96e13fe5f7200add4431f6be8755c4f9d9dd2"} Jun 09 01:16:19.205928 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.205900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-998pt" event={"ID":"a2f47376-5df3-4985-b0c6-c990a3c55be7","Type":"ContainerStarted","Data":"dcbb6c44b43e271c753a0b2167f5373fda77e83257b7b6ed14eb6f6c771ae7dd"} Jun 09 01:16:19.207325 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.207258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h8nn4" event={"ID":"78590a40-2814-4aa6-b641-5ebe8fef8959","Type":"ContainerStarted","Data":"893d07ee6302576696e4c20a9e8f89c69535ee18fe4ceafef701c860ed71c9b2"} Jun 09 01:16:19.209559 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.209542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bzlf9" event={"ID":"8a1be551-82d0-4400-bae3-7d50b6c42a2d","Type":"ContainerStarted","Data":"58c55eba95a4fbfa067c3b3ac44bd23c4765a4db196e2dae9fbff54e98ec1e00"} Jun 09 01:16:19.216219 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.216174 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-196.ec2.internal" podStartSLOduration=21.216138948 podStartE2EDuration="21.216138948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:02.18077057 +0000 UTC m=+5.534082886" watchObservedRunningTime="2026-06-09 01:16:19.216138948 +0000 UTC m=+22.569451272" Jun 09 01:16:19.216617 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.216592 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mm65c" podStartSLOduration=3.5939618749999998 podStartE2EDuration="22.216573853s" totalImagesPullingTime="18.622611978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:19.216108596 +0000 UTC m=+22.569420925" watchObservedRunningTime="2026-06-09 01:16:19.216573853 +0000 UTC m=+22.569886181" Jun 09 01:16:19.267969 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.267931 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7l5q6" podStartSLOduration=3.6415913509999998 podStartE2EDuration="22.267918234s" totalImagesPullingTime="18.626326883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:19.267601701 +0000 UTC m=+22.620914049" watchObservedRunningTime="2026-06-09 01:16:19.267918234 +0000 UTC m=+22.621230556" Jun 09 01:16:19.268130 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.268111 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h8nn4" podStartSLOduration=3.5956679879999998 podStartE2EDuration="22.268105989s" totalImagesPullingTime="18.672438001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:19.253182119 +0000 UTC m=+22.606494442" watchObservedRunningTime="2026-06-09 01:16:19.268105989 +0000 UTC m=+22.621418312" Jun 09 01:16:19.280941 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.280906 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-998pt" podStartSLOduration=3.62311689 podStartE2EDuration="22.280891771s" totalImagesPullingTime="18.657774881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:19.280466303 +0000 UTC m=+22.633778627" watchObservedRunningTime="2026-06-09 01:16:19.280891771 +0000 UTC m=+22.634204095" Jun 09 01:16:19.294202 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.294167 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bzlf9" podStartSLOduration=3.645305054 podStartE2EDuration="22.294155851s" totalImagesPullingTime="18.648850797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:19.293805232 +0000 UTC m=+22.647117555" watchObservedRunningTime="2026-06-09 01:16:19.294155851 +0000 UTC m=+22.647468175" Jun 09 01:16:19.442363 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.442324 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:16:19.443021 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.443000 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:16:19.765753 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:19.765732 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 01:16:20.093674 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.093518 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T01:16:19.765748122Z","UUID":"93429582-9acf-493d-a9aa-46951304313f","Handler":null,"Name":"","Endpoint":""} Jun 09 01:16:20.095330 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.095309 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 01:16:20.095472 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.095351 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 01:16:20.215328 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.215300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:16:20.215833 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.215803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"e0197d43201fc4682ebff964a16521b622eaec3325d2bba6738ef715b02f8fd9"} Jun 09 01:16:20.215976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.215881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"9ee6114e690d311ff6b7fd5a13a709de5bfeeb52bae87cd50cc79108d933a03d"} Jun 09 01:16:20.215976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.215918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"8bd48990f221f1d80bc5bde76d28263636f97add8486ba956b6eec7cdbc61a34"} Jun 09 01:16:20.215976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.215962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"a7423a57113b700ac6c86b7f6685a8f96fed2674f3f75f8ed59f49144185cc17"} Jun 09 01:16:20.217962 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.217935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" event={"ID":"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac","Type":"ContainerStarted","Data":"2d8560c3a2eaff8abb1030f1fa7c830c4fbe417f3c9aee9b294842b525ed04ea"} Jun 09 01:16:20.218930 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.218784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:16:20.219127 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:20.219112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7l5q6" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.091893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.091961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.091965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:21.092065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:21.092156 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:21.092274 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:21.092249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:21.222224 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.222184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" event={"ID":"2b307aba-6965-41c6-a1ee-e2ae9b0d65ac","Type":"ContainerStarted","Data":"6f9284f278732f3ca0452880d8b71d2a2a52d1fad19ff566797e53ae27cd3d45"} Jun 09 01:16:21.223820 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.223774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbrmj" event={"ID":"5fef7f16-0e43-449f-bbe7-2248ea54110e","Type":"ContainerStarted","Data":"658ebc49c164fd2dccd7af01ef340750b1fa1ecf2b67a0a0c9c65778ed9d24c6"} Jun 09 01:16:21.239252 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:21.239204 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bvgx" podStartSLOduration=4.252114112 podStartE2EDuration="24.239192497s" totalImagesPullingTime="19.987078385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:21.238019349 +0000 UTC m=+24.591331719" watchObservedRunningTime="2026-06-09 01:16:21.239192497 +0000 UTC m=+24.592504820" Jun 09 01:16:22.229638 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:22.229455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:16:22.230081 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:22.230054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"41297f6eee0b702c970ec9196c13808e2c6abf9caf046869490c9698aff79254"} Jun 09 01:16:23.092154 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:23.092122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:23.092400 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:23.092130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:23.092400 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:23.092230 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:23.092400 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:23.092321 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:23.092400 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:23.092138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:23.092592 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:23.092413 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:24.236153 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.235857 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="2bbb8c663cfdc6870369a048b7e02400b093f84401cf0e6dd7b45328689ea74b" exitCode=0 Jun 09 01:16:24.236930 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.235936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"2bbb8c663cfdc6870369a048b7e02400b093f84401cf0e6dd7b45328689ea74b"} Jun 09 01:16:24.239877 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.239858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:16:24.240224 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.240205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"a9bce7d7a85f2ff35debd7cebbfb3200d06c295bb011803b8b1da214eeb88b6b"} Jun 09 01:16:24.240437 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.240422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:16:24.240501 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.240482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:16:24.240631 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.240613 2576 scope.go:117] "RemoveContainer" containerID="a352816443d627ae947de40e5c2626836325a5d4155969371b2f040d5f1e9937" Jun 09 01:16:24.256224 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.256207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:16:24.258437 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:24.258404 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nbrmj" podStartSLOduration=8.625112664 podStartE2EDuration="27.258393993s" totalImagesPullingTime="18.633281329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:21.252280636 +0000 UTC m=+24.605592960" watchObservedRunningTime="2026-06-09 01:16:24.258393993 +0000 UTC m=+27.611706316" Jun 09 01:16:25.094807 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.094781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:25.095002 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.094876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:25.095002 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.094881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:25.095002 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.094909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:25.095119 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.094997 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:25.095119 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.095069 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:25.246440 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.246419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:16:25.246840 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.246775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" event={"ID":"0e999ebe-4200-48d6-a68e-d8d55a859c39","Type":"ContainerStarted","Data":"32619b69ee25eaedc75eaba0349403a02b2b82973ecddb4c721091c259dd9f35"} Jun 09 01:16:25.247165 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.247139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:16:25.263498 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.263474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:16:25.277211 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.277170 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" podStartSLOduration=9.576878117 podStartE2EDuration="28.277158487s" totalImagesPullingTime="18.70028037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:25.275495139 +0000 UTC m=+28.628807459" watchObservedRunningTime="2026-06-09 01:16:25.277158487 +0000 UTC m=+28.630470810" Jun 09 01:16:25.620825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.620793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2dqj"] Jun 09 01:16:25.621014 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.620896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:25.621014 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.620976 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:25.623865 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.623837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89hqz"] Jun 09 01:16:25.624025 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.623957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:25.624116 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.624077 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:25.624376 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.624348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5wr2g"] Jun 09 01:16:25.624476 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:25.624441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:25.624542 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:25.624523 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:26.250563 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:26.250529 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="9baf0c6aa2f1bc8703e58de4a14b3d18c1e940e436750980c08cffc085f360ae" exitCode=0 Jun 09 01:16:26.250941 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:26.250609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"9baf0c6aa2f1bc8703e58de4a14b3d18c1e940e436750980c08cffc085f360ae"} Jun 09 01:16:27.094698 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:27.094667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:27.094895 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:27.094791 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:27.094895 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:27.094844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:27.095006 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:27.094935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:27.095006 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:27.094968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:27.095099 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:27.095012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:28.258219 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:28.258046 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="10dc024b7a5f726ad26b24c06a077370ffa5cb4e0c9dd09dc21c07ce105e3921" exitCode=0 Jun 09 01:16:28.258710 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:28.258113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"10dc024b7a5f726ad26b24c06a077370ffa5cb4e0c9dd09dc21c07ce105e3921"} Jun 09 01:16:29.092264 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:29.092236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:29.092264 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:29.092251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:29.092529 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:29.092391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:29.092529 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:29.092426 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:29.092529 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:29.092462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:29.092681 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:29.092563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:30.888371 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:30.888336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:30.888925 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:30.888386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:30.888925 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.888483 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:30.888925 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.888501 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:30.888925 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.888553 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret podName:aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab nodeName:}" failed. No retries permitted until 2026-06-09 01:17:02.888532874 +0000 UTC m=+66.241845176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret") pod "global-pull-secret-syncer-d2dqj" (UID: "aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:30.888925 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.888580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:17:02.888561131 +0000 UTC m=+66.241873433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:30.988698 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:30.988663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:30.988883 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.988850 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:30.988883 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.988874 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:30.988883 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.988884 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8kqzq for pod openshift-network-diagnostics/network-check-target-5wr2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:30.989049 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:30.988937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq podName:614180d0-1dc0-4a83-8cb6-faceb3ca1e04 nodeName:}" failed. No retries permitted until 2026-06-09 01:17:02.988922778 +0000 UTC m=+66.342235084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kqzq" (UniqueName: "kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq") pod "network-check-target-5wr2g" (UID: "614180d0-1dc0-4a83-8cb6-faceb3ca1e04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:31.094556 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.094525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:31.094709 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.094525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:31.094709 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:31.094637 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wr2g" podUID="614180d0-1dc0-4a83-8cb6-faceb3ca1e04" Jun 09 01:16:31.094853 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.094527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:31.094853 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:31.094749 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:16:31.094948 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:31.094874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2dqj" podUID="aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab" Jun 09 01:16:31.481070 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.481040 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-196.ec2.internal" event="NodeReady" Jun 09 01:16:31.481240 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.481184 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 01:16:31.525708 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.525668 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d6js2"] Jun 09 01:16:31.559791 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.559703 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v77p4"] Jun 09 01:16:31.559929 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.559850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.562658 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.562633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 01:16:31.562658 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.562646 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 01:16:31.562928 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.562912 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9cpl\"" Jun 09 01:16:31.582705 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.582624 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v77p4"] Jun 09 01:16:31.582705 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.582664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6js2"] Jun 09 01:16:31.582893 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.582715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.585374 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.585347 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 01:16:31.585471 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.585386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7cpv6\"" Jun 09 01:16:31.585643 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.585624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 01:16:31.585894 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.585873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 01:16:31.693117 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-config-volume\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.693117 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab2fc06-2933-4787-8afb-f17c0d01df76-cert\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.693369 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-tmp-dir\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.693369 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzv9r\" (UniqueName: \"kubernetes.io/projected/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-kube-api-access-nzv9r\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.693369 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjbs\" (UniqueName: \"kubernetes.io/projected/bab2fc06-2933-4787-8afb-f17c0d01df76-kube-api-access-xmjbs\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.693369 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.693306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.794650 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjbs\" (UniqueName: \"kubernetes.io/projected/bab2fc06-2933-4787-8afb-f17c0d01df76-kube-api-access-xmjbs\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.794831 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.794831 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-config-volume\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.794831 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab2fc06-2933-4787-8afb-f17c0d01df76-cert\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.794831 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-tmp-dir\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.794831 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:31.794815 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:31.795084 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.794861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv9r\" (UniqueName: \"kubernetes.io/projected/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-kube-api-access-nzv9r\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.795084 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:31.794878 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:32.29485896 +0000 UTC m=+35.648171273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:31.795281 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.795259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-tmp-dir\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.795346 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.795328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-config-volume\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.799518 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.799498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab2fc06-2933-4787-8afb-f17c0d01df76-cert\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.803668 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.803641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzv9r\" (UniqueName: \"kubernetes.io/projected/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-kube-api-access-nzv9r\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:31.803781 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.803693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjbs\" (UniqueName: \"kubernetes.io/projected/bab2fc06-2933-4787-8afb-f17c0d01df76-kube-api-access-xmjbs\") pod \"ingress-canary-v77p4\" (UID: \"bab2fc06-2933-4787-8afb-f17c0d01df76\") " pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:31.892860 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:31.892828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v77p4" Jun 09 01:16:32.299202 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:32.299171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:32.299355 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:32.299303 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:32.299355 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:32.299354 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:33.299340903 +0000 UTC m=+36.652653205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:32.322667 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:32.322642 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v77p4"] Jun 09 01:16:32.326653 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:16:32.326630 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab2fc06_2933_4787_8afb_f17c0d01df76.slice/crio-57cc8dc62cd18bf533d006b0a8bc231c1ed05ea58b7e43a3f15cd747536bf044 WatchSource:0}: Error finding container 57cc8dc62cd18bf533d006b0a8bc231c1ed05ea58b7e43a3f15cd747536bf044: Status 404 returned error can't find the container with id 57cc8dc62cd18bf533d006b0a8bc231c1ed05ea58b7e43a3f15cd747536bf044 Jun 09 01:16:33.095413 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.095381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:16:33.095893 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.095495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:16:33.095893 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.095691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:16:33.100052 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.098705 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 01:16:33.100052 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.098751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 01:16:33.100524 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.100494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pwvx\"" Jun 09 01:16:33.100641 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.100563 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 01:16:33.100641 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.100573 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 01:16:33.100749 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.100565 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljzbq\"" Jun 09 01:16:33.274824 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.274712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v77p4" event={"ID":"bab2fc06-2933-4787-8afb-f17c0d01df76","Type":"ContainerStarted","Data":"57cc8dc62cd18bf533d006b0a8bc231c1ed05ea58b7e43a3f15cd747536bf044"} Jun 09 01:16:33.277591 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.277554 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="493bf1afc2cbad208b0494223c20053762e7260d3c4fccdb407d1d9fe30c5b1c" exitCode=0 Jun 09 01:16:33.277722 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.277612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"493bf1afc2cbad208b0494223c20053762e7260d3c4fccdb407d1d9fe30c5b1c"} Jun 09 01:16:33.307500 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:33.307475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:33.307680 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:33.307661 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:33.307748 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:33.307735 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:35.307713061 +0000 UTC m=+38.661025382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:34.281253 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:34.281224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v77p4" event={"ID":"bab2fc06-2933-4787-8afb-f17c0d01df76","Type":"ContainerStarted","Data":"308b8c04dbb8bc2b4f94918d9ea183c551263093d7eb323a79aae9a7b7fb1ba2"} Jun 09 01:16:34.284371 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:34.284348 2576 generic.go:356] "Generic (PLEG): container finished" podID="d60e6bc1-55de-4238-9ca5-cbaba16d5c37" containerID="70b66d816466cab29de11a27ed5ae434476a18e45d0822359d85588fecfdd9fa" exitCode=0 Jun 09 01:16:34.284466 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:34.284383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerDied","Data":"70b66d816466cab29de11a27ed5ae434476a18e45d0822359d85588fecfdd9fa"} Jun 09 01:16:34.295979 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:34.295916 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v77p4" podStartSLOduration=1.420318572 podStartE2EDuration="3.295896997s" totalImagesPullingTime="1.875578425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:34.295589458 +0000 UTC m=+37.648901821" watchObservedRunningTime="2026-06-09 01:16:34.295896997 +0000 UTC m=+37.649209321" Jun 09 01:16:35.289573 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:35.289395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22w6m" event={"ID":"d60e6bc1-55de-4238-9ca5-cbaba16d5c37","Type":"ContainerStarted","Data":"40348f226479cb8c17fc48211c8954605adb03e493966746ff1b774107845927"} Jun 09 01:16:35.312730 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:35.312686 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-22w6m" podStartSLOduration=8.834293543 podStartE2EDuration="38.31266955s" totalImagesPullingTime="29.478376007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:35.310678173 +0000 UTC m=+38.663990502" watchObservedRunningTime="2026-06-09 01:16:35.31266955 +0000 UTC m=+38.665981873" Jun 09 01:16:35.323166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:35.323144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:35.323268 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:35.323256 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:35.323306 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:35.323302 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:39.323290487 +0000 UTC m=+42.676602790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:39.348508 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:39.348474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:39.348894 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:39.348584 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:39.348894 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:39.348634 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:47.348620997 +0000 UTC m=+50.701933300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:47.400216 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:47.400176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:16:47.400742 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:47.400314 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:47.400742 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:16:47.400376 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:17:03.400358526 +0000 UTC m=+66.753670829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:16:57.273092 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:16:57.273066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbcbf" Jun 09 01:17:02.901463 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:02.901420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:17:02.901463 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:02.901470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:17:02.904524 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:02.904507 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 01:17:02.904581 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:02.904536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 01:17:02.911853 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:02.911832 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 01:17:02.911924 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:02.911911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:06.911891682 +0000 UTC m=+130.265203998 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : secret "metrics-daemon-secret" not found Jun 09 01:17:02.915437 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:02.915413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab-original-pull-secret\") pod \"global-pull-secret-syncer-d2dqj\" (UID: \"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab\") " pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:17:03.002585 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.002546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:17:03.005358 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.005342 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 01:17:03.015750 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.015734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 01:17:03.026023 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.025998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqzq\" (UniqueName: \"kubernetes.io/projected/614180d0-1dc0-4a83-8cb6-faceb3ca1e04-kube-api-access-8kqzq\") pod \"network-check-target-5wr2g\" (UID: \"614180d0-1dc0-4a83-8cb6-faceb3ca1e04\") " pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:17:03.109043 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.109013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2dqj" Jun 09 01:17:03.123840 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.123823 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljzbq\"" Jun 09 01:17:03.131192 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.131176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:17:03.270409 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.270373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2dqj"] Jun 09 01:17:03.273628 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:17:03.273600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7e8f4c_f0fa_4aaf_9e22_b4c95228b7ab.slice/crio-aaf1224f96b89f4bad92ff50f271c8f0f7e38df4284a8803bfc2e7a1db6e47e5 WatchSource:0}: Error finding container aaf1224f96b89f4bad92ff50f271c8f0f7e38df4284a8803bfc2e7a1db6e47e5: Status 404 returned error can't find the container with id aaf1224f96b89f4bad92ff50f271c8f0f7e38df4284a8803bfc2e7a1db6e47e5 Jun 09 01:17:03.290130 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.290083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5wr2g"] Jun 09 01:17:03.292307 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:17:03.292286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614180d0_1dc0_4a83_8cb6_faceb3ca1e04.slice/crio-8a70546dca567b58c74a54e7bab48253f714c5b773370a378811f90a1c01ef1d WatchSource:0}: Error finding container 8a70546dca567b58c74a54e7bab48253f714c5b773370a378811f90a1c01ef1d: Status 404 returned error can't find the container with id 8a70546dca567b58c74a54e7bab48253f714c5b773370a378811f90a1c01ef1d Jun 09 01:17:03.351235 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.351209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2dqj" event={"ID":"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab","Type":"ContainerStarted","Data":"aaf1224f96b89f4bad92ff50f271c8f0f7e38df4284a8803bfc2e7a1db6e47e5"} Jun 09 01:17:03.352198 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.352179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5wr2g" event={"ID":"614180d0-1dc0-4a83-8cb6-faceb3ca1e04","Type":"ContainerStarted","Data":"8a70546dca567b58c74a54e7bab48253f714c5b773370a378811f90a1c01ef1d"} Jun 09 01:17:03.406800 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:03.406736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:17:03.406893 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:03.406878 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:17:03.406946 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:03.406937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:17:35.406920194 +0000 UTC m=+98.760232496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:17:08.366654 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:08.366613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5wr2g" event={"ID":"614180d0-1dc0-4a83-8cb6-faceb3ca1e04","Type":"ContainerStarted","Data":"5b4b955e4ad640af57f2345abe07e27fd33f900f8345b85415b487db569d8c50"} Jun 09 01:17:08.367203 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:08.366735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:17:08.368018 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:08.367998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2dqj" event={"ID":"aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab","Type":"ContainerStarted","Data":"3db58c3a7254b00512e036cb8d5b7117208d28612c30aeac02d82d0e3ad73c64"} Jun 09 01:17:08.383061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:08.383013 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5wr2g" podStartSLOduration=67.169884077 podStartE2EDuration="1m11.38300264s" totalImagesPullingTime="4.213118563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:17:08.381997286 +0000 UTC m=+71.735309610" watchObservedRunningTime="2026-06-09 01:17:08.38300264 +0000 UTC m=+71.736314955" Jun 09 01:17:08.396048 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:08.396010 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2dqj" podStartSLOduration=67.160900247 podStartE2EDuration="1m11.39599741s" totalImagesPullingTime="4.235097163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:17:08.395110114 +0000 UTC m=+71.748422448" watchObservedRunningTime="2026-06-09 01:17:08.39599741 +0000 UTC m=+71.749309733" Jun 09 01:17:35.416106 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:35.416013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:17:35.416480 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:35.416165 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:17:35.416480 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:17:35.416240 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:39.416222998 +0000 UTC m=+162.769535301 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:17:39.373068 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:17:39.373038 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5wr2g" Jun 09 01:18:06.929101 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:06.929051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:18:06.929660 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:06.929188 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 01:18:06.929660 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:06.929280 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs podName:469e649f-3a27-4ccf-93c3-8bc1398f1136 nodeName:}" failed. No retries permitted until 2026-06-09 01:20:08.929257211 +0000 UTC m=+252.282569518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs") pod "network-metrics-daemon-89hqz" (UID: "469e649f-3a27-4ccf-93c3-8bc1398f1136") : secret "metrics-daemon-secret" not found Jun 09 01:18:34.570250 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:34.570213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d6js2" podUID="50d0cea5-f5be-4c7d-8d25-294bac0dcde6" Jun 09 01:18:35.569130 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.569053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6js2" Jun 09 01:18:35.727088 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.727058 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4"] Jun 09 01:18:35.728700 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.728684 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9"] Jun 09 01:18:35.728826 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.728811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.730317 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.730296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.731326 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.731309 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 01:18:35.731476 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.731461 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:18:35.731551 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.731491 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 01:18:35.731551 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.731508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 01:18:35.732673 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.732655 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fqkzc\"" Jun 09 01:18:35.733101 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.733085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dqgd6\"" Jun 09 01:18:35.733342 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.733327 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 01:18:35.733445 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.733430 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 01:18:35.733445 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.733438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 01:18:35.733558 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.733507 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 01:18:35.741903 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.741885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4"] Jun 09 01:18:35.742503 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.742482 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9"] Jun 09 01:18:35.818293 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.818264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm57h\" (UniqueName: \"kubernetes.io/projected/dcd39cff-b62a-4f55-946d-2d4d5269b82a-kube-api-access-nm57h\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.818464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.818320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ea80f95-b679-4647-a5ea-62e2840f5c0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.818464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.818342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd39cff-b62a-4f55-946d-2d4d5269b82a-config\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.818464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.818414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd39cff-b62a-4f55-946d-2d4d5269b82a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.818464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.818459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq28x\" (UniqueName: \"kubernetes.io/projected/6ea80f95-b679-4647-a5ea-62e2840f5c0c-kube-api-access-rq28x\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.846576 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.846549 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt"] Jun 09 01:18:35.848291 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.848275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:35.849348 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.849330 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt"] Jun 09 01:18:35.850902 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.850885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 01:18:35.851129 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.851114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:35.854201 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.854179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 01:18:35.854499 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.854483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 01:18:35.854716 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.854699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 01:18:35.854822 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.854807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 01:18:35.859070 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.859049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt"] Jun 09 01:18:35.862080 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.862060 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt"] Jun 09 01:18:35.919277 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.919247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq28x\" (UniqueName: \"kubernetes.io/projected/6ea80f95-b679-4647-a5ea-62e2840f5c0c-kube-api-access-rq28x\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.919421 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.919295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm57h\" (UniqueName: \"kubernetes.io/projected/dcd39cff-b62a-4f55-946d-2d4d5269b82a-kube-api-access-nm57h\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.919421 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.919356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ea80f95-b679-4647-a5ea-62e2840f5c0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.919538 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.919409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd39cff-b62a-4f55-946d-2d4d5269b82a-config\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.919538 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.919459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd39cff-b62a-4f55-946d-2d4d5269b82a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.920031 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.920007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd39cff-b62a-4f55-946d-2d4d5269b82a-config\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.921574 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.921553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd39cff-b62a-4f55-946d-2d4d5269b82a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:35.921872 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.921853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ea80f95-b679-4647-a5ea-62e2840f5c0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.933006 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.932985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq28x\" (UniqueName: \"kubernetes.io/projected/6ea80f95-b679-4647-a5ea-62e2840f5c0c-kube-api-access-rq28x\") pod \"managed-serviceaccount-addon-agent-67f9765d56-mh2c9\" (UID: \"6ea80f95-b679-4647-a5ea-62e2840f5c0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:35.935368 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:35.935348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm57h\" (UniqueName: \"kubernetes.io/projected/dcd39cff-b62a-4f55-946d-2d4d5269b82a-kube-api-access-nm57h\") pod \"service-ca-operator-6bc5ff68f5-r24h4\" (UID: \"dcd39cff-b62a-4f55-946d-2d4d5269b82a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:36.020656 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1588bcbd-8f91-4d6a-8960-040c05fc560d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.020825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.020825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.020825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.020825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxwj\" (UniqueName: \"kubernetes.io/projected/1588bcbd-8f91-4d6a-8960-040c05fc560d-kube-api-access-jfxwj\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.020825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4abcd9be-6a0e-479c-853c-38d5859a97a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.021000 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.021000 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abcd9be-6a0e-479c-853c-38d5859a97a6-tmp\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.021000 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.020871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjkfs\" (UniqueName: \"kubernetes.io/projected/4abcd9be-6a0e-479c-853c-38d5859a97a6-kube-api-access-hjkfs\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.038731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.038709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" Jun 09 01:18:36.052161 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.052141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" Jun 09 01:18:36.115396 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:36.115361 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-89hqz" podUID="469e649f-3a27-4ccf-93c3-8bc1398f1136" Jun 09 01:18:36.122228 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122338 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abcd9be-6a0e-479c-853c-38d5859a97a6-tmp\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.122338 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjkfs\" (UniqueName: \"kubernetes.io/projected/4abcd9be-6a0e-479c-853c-38d5859a97a6-kube-api-access-hjkfs\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.122338 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1588bcbd-8f91-4d6a-8960-040c05fc560d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxwj\" (UniqueName: \"kubernetes.io/projected/1588bcbd-8f91-4d6a-8960-040c05fc560d-kube-api-access-jfxwj\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.122490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4abcd9be-6a0e-479c-853c-38d5859a97a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.122933 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.122906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abcd9be-6a0e-479c-853c-38d5859a97a6-tmp\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.123572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.123544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1588bcbd-8f91-4d6a-8960-040c05fc560d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.125633 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.125597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.125633 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.125608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-ca\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.126180 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.126129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.126288 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.126269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1588bcbd-8f91-4d6a-8960-040c05fc560d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.126404 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.126385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4abcd9be-6a0e-479c-853c-38d5859a97a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.132870 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.132595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjkfs\" (UniqueName: \"kubernetes.io/projected/4abcd9be-6a0e-479c-853c-38d5859a97a6-kube-api-access-hjkfs\") pod \"klusterlet-addon-workmgr-5865796854-ws5dt\" (UID: \"4abcd9be-6a0e-479c-853c-38d5859a97a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.133106 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.133083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxwj\" (UniqueName: \"kubernetes.io/projected/1588bcbd-8f91-4d6a-8960-040c05fc560d-kube-api-access-jfxwj\") pod \"cluster-proxy-proxy-agent-df74b54cd-zjdkt\" (UID: \"1588bcbd-8f91-4d6a-8960-040c05fc560d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.161203 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.161181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:36.167007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.166976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:18:36.168361 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.168309 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4"] Jun 09 01:18:36.171227 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:18:36.171207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd39cff_b62a_4f55_946d_2d4d5269b82a.slice/crio-11e6e88a7e0a5b6b55a2077435e4090447af6089323ed24c70c4a9143208b425 WatchSource:0}: Error finding container 11e6e88a7e0a5b6b55a2077435e4090447af6089323ed24c70c4a9143208b425: Status 404 returned error can't find the container with id 11e6e88a7e0a5b6b55a2077435e4090447af6089323ed24c70c4a9143208b425 Jun 09 01:18:36.182832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.182809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9"] Jun 09 01:18:36.184746 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:18:36.184716 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ea80f95_b679_4647_a5ea_62e2840f5c0c.slice/crio-a2c46147765e1191b4c88d95b6aeee73ab434a7106e6f04f48603c50235d01ab WatchSource:0}: Error finding container a2c46147765e1191b4c88d95b6aeee73ab434a7106e6f04f48603c50235d01ab: Status 404 returned error can't find the container with id a2c46147765e1191b4c88d95b6aeee73ab434a7106e6f04f48603c50235d01ab Jun 09 01:18:36.289841 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.289814 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt"] Jun 09 01:18:36.292665 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:18:36.292640 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abcd9be_6a0e_479c_853c_38d5859a97a6.slice/crio-2dafa3918db01d9d0a2b9242c85c3808535a03f7e3981ec37cdb585f0cb83952 WatchSource:0}: Error finding container 2dafa3918db01d9d0a2b9242c85c3808535a03f7e3981ec37cdb585f0cb83952: Status 404 returned error can't find the container with id 2dafa3918db01d9d0a2b9242c85c3808535a03f7e3981ec37cdb585f0cb83952 Jun 09 01:18:36.306129 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.306107 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt"] Jun 09 01:18:36.308801 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:18:36.308781 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1588bcbd_8f91_4d6a_8960_040c05fc560d.slice/crio-d053f364a8a973a06c0891be0c5e88cb2868de00c9d460e17846d66e2c6bf0ae WatchSource:0}: Error finding container d053f364a8a973a06c0891be0c5e88cb2868de00c9d460e17846d66e2c6bf0ae: Status 404 returned error can't find the container with id d053f364a8a973a06c0891be0c5e88cb2868de00c9d460e17846d66e2c6bf0ae Jun 09 01:18:36.572437 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.572349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerStarted","Data":"d053f364a8a973a06c0891be0c5e88cb2868de00c9d460e17846d66e2c6bf0ae"} Jun 09 01:18:36.573375 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.573344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" event={"ID":"6ea80f95-b679-4647-a5ea-62e2840f5c0c","Type":"ContainerStarted","Data":"a2c46147765e1191b4c88d95b6aeee73ab434a7106e6f04f48603c50235d01ab"} Jun 09 01:18:36.574306 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.574280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" event={"ID":"dcd39cff-b62a-4f55-946d-2d4d5269b82a","Type":"ContainerStarted","Data":"11e6e88a7e0a5b6b55a2077435e4090447af6089323ed24c70c4a9143208b425"} Jun 09 01:18:36.575128 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:36.575108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" event={"ID":"4abcd9be-6a0e-479c-853c-38d5859a97a6","Type":"ContainerStarted","Data":"2dafa3918db01d9d0a2b9242c85c3808535a03f7e3981ec37cdb585f0cb83952"} Jun 09 01:18:39.451778 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:39.451725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:18:39.452277 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:39.451909 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:18:39.452277 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:18:39.451980 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls podName:50d0cea5-f5be-4c7d-8d25-294bac0dcde6 nodeName:}" failed. No retries permitted until 2026-06-09 01:20:41.451959433 +0000 UTC m=+284.805271763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls") pod "dns-default-d6js2" (UID: "50d0cea5-f5be-4c7d-8d25-294bac0dcde6") : secret "dns-default-metrics-tls" not found Jun 09 01:18:42.626543 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:42.626516 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bzlf9_8a1be551-82d0-4400-bae3-7d50b6c42a2d/dns-node-resolver/0.log" Jun 09 01:18:43.605055 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.605023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerStarted","Data":"15aa13a7f2857dcce1f7b6edf7ed377e892e05d914fecc275c450aeba49205af"} Jun 09 01:18:43.605174 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.605076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerStarted","Data":"969c5d6f7ccb509e1ae11fc893c27560847c275baf7d1b6b77862350a2e398b6"} Jun 09 01:18:43.606396 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.606356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" event={"ID":"6ea80f95-b679-4647-a5ea-62e2840f5c0c","Type":"ContainerStarted","Data":"30d4c9b6c0e004bb298aed9d69fbd643b62962d0debe0854ef78fa88a66e4bf2"} Jun 09 01:18:43.607903 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.607851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" event={"ID":"dcd39cff-b62a-4f55-946d-2d4d5269b82a","Type":"ContainerStarted","Data":"43ebcea0948cf7ac72627a3f242348013cd50fee5888a809fbf5dcfa2bb502b8"} Jun 09 01:18:43.609260 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.609236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" event={"ID":"4abcd9be-6a0e-479c-853c-38d5859a97a6","Type":"ContainerStarted","Data":"25cca085c3bca594a6a906ce4e1095ec0782f2fe25348bbbf01b24e6665ec13d"} Jun 09 01:18:43.609477 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.609460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:43.611137 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.611046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:18:43.620379 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.620331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" podStartSLOduration=1.443181155 podStartE2EDuration="8.620314972s" totalImagesPullingTime="7.177133817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:43.619434259 +0000 UTC m=+166.972746608" watchObservedRunningTime="2026-06-09 01:18:43.620314972 +0000 UTC m=+166.973627297" Jun 09 01:18:43.635920 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.635871 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" podStartSLOduration=1.527090775 podStartE2EDuration="8.635853247s" totalImagesPullingTime="7.108762472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:43.635169695 +0000 UTC m=+166.988482056" watchObservedRunningTime="2026-06-09 01:18:43.635853247 +0000 UTC m=+166.989165573" Jun 09 01:18:43.651193 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:43.651146 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" podStartSLOduration=1.4674460329999999 podStartE2EDuration="8.651132875s" totalImagesPullingTime="7.183686842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:43.650908708 +0000 UTC m=+167.004221029" watchObservedRunningTime="2026-06-09 01:18:43.651132875 +0000 UTC m=+167.004445198" Jun 09 01:18:44.027099 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:44.027021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-998pt_a2f47376-5df3-4985-b0c6-c990a3c55be7/node-ca/0.log" Jun 09 01:18:44.614051 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:44.614014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerStarted","Data":"0db3ffa0661a3bdc744902d969aa3be37f372869767f6c1d29291bcb1dacb8a9"} Jun 09 01:18:44.632572 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:44.632522 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" podStartSLOduration=2.52070066 podStartE2EDuration="9.632509024s" totalImagesPullingTime="7.111808364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:44.631802198 +0000 UTC m=+167.985114519" watchObservedRunningTime="2026-06-09 01:18:44.632509024 +0000 UTC m=+167.985821390" Jun 09 01:18:44.827385 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:44.827354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v77p4_bab2fc06-2933-4787-8afb-f17c0d01df76/serve-healthcheck-canary/0.log" Jun 09 01:18:48.091692 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:18:48.091656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:19:06.530433 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.530402 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pm69f"] Jun 09 01:19:06.534600 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.534583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.537358 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.537333 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-knzt7\"" Jun 09 01:19:06.538582 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.538563 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 01:19:06.538685 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.538584 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 01:19:06.538685 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.538585 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 01:19:06.538685 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.538629 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 01:19:06.544210 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.544189 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pm69f"] Jun 09 01:19:06.626935 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.626904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e249f093-5f45-4184-ba31-6f60e3d11049-data-volume\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.627107 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.626943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e249f093-5f45-4184-ba31-6f60e3d11049-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.627107 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.627033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e249f093-5f45-4184-ba31-6f60e3d11049-crio-socket\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.627107 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.627065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e249f093-5f45-4184-ba31-6f60e3d11049-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.627245 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.627131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tjp\" (UniqueName: \"kubernetes.io/projected/e249f093-5f45-4184-ba31-6f60e3d11049-kube-api-access-67tjp\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728446 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e249f093-5f45-4184-ba31-6f60e3d11049-data-volume\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e249f093-5f45-4184-ba31-6f60e3d11049-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e249f093-5f45-4184-ba31-6f60e3d11049-crio-socket\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e249f093-5f45-4184-ba31-6f60e3d11049-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tjp\" (UniqueName: \"kubernetes.io/projected/e249f093-5f45-4184-ba31-6f60e3d11049-kube-api-access-67tjp\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728730 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e249f093-5f45-4184-ba31-6f60e3d11049-crio-socket\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.728832 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.728814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e249f093-5f45-4184-ba31-6f60e3d11049-data-volume\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.729133 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.729115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e249f093-5f45-4184-ba31-6f60e3d11049-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.730797 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.730778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e249f093-5f45-4184-ba31-6f60e3d11049-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.736618 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.736593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tjp\" (UniqueName: \"kubernetes.io/projected/e249f093-5f45-4184-ba31-6f60e3d11049-kube-api-access-67tjp\") pod \"insights-runtime-extractor-pm69f\" (UID: \"e249f093-5f45-4184-ba31-6f60e3d11049\") " pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.843841 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.843819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pm69f" Jun 09 01:19:06.965098 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:06.965076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pm69f"] Jun 09 01:19:06.967590 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:19:06.967563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode249f093_5f45_4184_ba31_6f60e3d11049.slice/crio-624571906bec8ff8cb5bca356c9f1a42ecfb032fa29e3a8dc53bdc015026bbaa WatchSource:0}: Error finding container 624571906bec8ff8cb5bca356c9f1a42ecfb032fa29e3a8dc53bdc015026bbaa: Status 404 returned error can't find the container with id 624571906bec8ff8cb5bca356c9f1a42ecfb032fa29e3a8dc53bdc015026bbaa Jun 09 01:19:07.685005 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:07.684972 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm69f" event={"ID":"e249f093-5f45-4184-ba31-6f60e3d11049","Type":"ContainerStarted","Data":"e7ab4ac66778dd335506ccc68b7829517e2f6ef0bd9991ae7e0e7d9a7d519122"} Jun 09 01:19:07.685344 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:07.685031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm69f" event={"ID":"e249f093-5f45-4184-ba31-6f60e3d11049","Type":"ContainerStarted","Data":"624571906bec8ff8cb5bca356c9f1a42ecfb032fa29e3a8dc53bdc015026bbaa"} Jun 09 01:19:08.690807 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:08.690747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm69f" event={"ID":"e249f093-5f45-4184-ba31-6f60e3d11049","Type":"ContainerStarted","Data":"f6f19a796afbd7becbf28e019657f71a8e1b8a61a4a3a2df6f76c32cd128625b"} Jun 09 01:19:09.695558 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:09.695467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm69f" event={"ID":"e249f093-5f45-4184-ba31-6f60e3d11049","Type":"ContainerStarted","Data":"568932fd1129c83e0949e70f09a6c3fbd71dbc79780d127dfd4062cf4416a5d0"} Jun 09 01:19:09.712251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:09.712205 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pm69f" podStartSLOduration=1.389525195 podStartE2EDuration="3.71219204s" totalImagesPullingTime="2.322666845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:19:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:09.711451324 +0000 UTC m=+193.064763674" watchObservedRunningTime="2026-06-09 01:19:09.71219204 +0000 UTC m=+193.065504364" Jun 09 01:19:17.801348 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.801316 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cfn7w"] Jun 09 01:19:17.863325 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.863297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.865914 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.865882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngzk6\"" Jun 09 01:19:17.866082 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.866065 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 01:19:17.866166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.866082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 01:19:17.867214 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.867194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 01:19:17.867214 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.867204 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 01:19:17.867408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.867320 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 01:19:17.867408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.867390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 01:19:17.903921 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.903901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-tls\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904043 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.903927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-metrics-client-ca\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904043 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.903949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904043 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.903976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-root\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904161 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.904053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904161 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.904085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-textfile\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904161 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.904111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgqgb\" (UniqueName: \"kubernetes.io/projected/0b405716-04dd-4c5f-9ed2-54631a55ab26-kube-api-access-vgqgb\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904161 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.904131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-wtmp\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:17.904296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:17.904176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-sys\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005149 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgqgb\" (UniqueName: \"kubernetes.io/projected/0b405716-04dd-4c5f-9ed2-54631a55ab26-kube-api-access-vgqgb\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005149 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-wtmp\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005149 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-sys\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005342 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-sys\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005342 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-wtmp\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-tls\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-metrics-client-ca\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005569 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-root\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005607 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005640 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-textfile\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005671 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b405716-04dd-4c5f-9ed2-54631a55ab26-root\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.005970 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-textfile\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.006054 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.005988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-metrics-client-ca\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.006135 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.006117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.007694 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.007673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-tls\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.007800 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.007729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b405716-04dd-4c5f-9ed2-54631a55ab26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.012730 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.012708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgqgb\" (UniqueName: \"kubernetes.io/projected/0b405716-04dd-4c5f-9ed2-54631a55ab26-kube-api-access-vgqgb\") pod \"node-exporter-cfn7w\" (UID: \"0b405716-04dd-4c5f-9ed2-54631a55ab26\") " pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.172101 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.172075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfn7w" Jun 09 01:19:18.205371 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:19:18.205347 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b405716_04dd_4c5f_9ed2_54631a55ab26.slice/crio-9cb783aab8683d6eec556e3a523d563a9f392fed4885fd5b8ace1a715ff67df8 WatchSource:0}: Error finding container 9cb783aab8683d6eec556e3a523d563a9f392fed4885fd5b8ace1a715ff67df8: Status 404 returned error can't find the container with id 9cb783aab8683d6eec556e3a523d563a9f392fed4885fd5b8ace1a715ff67df8 Jun 09 01:19:18.725660 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:18.725620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfn7w" event={"ID":"0b405716-04dd-4c5f-9ed2-54631a55ab26","Type":"ContainerStarted","Data":"9cb783aab8683d6eec556e3a523d563a9f392fed4885fd5b8ace1a715ff67df8"} Jun 09 01:19:19.730502 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:19.730471 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b405716-04dd-4c5f-9ed2-54631a55ab26" containerID="43150e9079c15c230b19da1f5bbcfe9d017dac6f12112870c1b89e88fe6626b8" exitCode=0 Jun 09 01:19:19.730879 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:19.730546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfn7w" event={"ID":"0b405716-04dd-4c5f-9ed2-54631a55ab26","Type":"ContainerDied","Data":"43150e9079c15c230b19da1f5bbcfe9d017dac6f12112870c1b89e88fe6626b8"} Jun 09 01:19:20.737494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:20.737460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfn7w" event={"ID":"0b405716-04dd-4c5f-9ed2-54631a55ab26","Type":"ContainerStarted","Data":"818c1cad63ef493ebb225f65878162fe477d246d2f4cb575b9042f9def67e126"} Jun 09 01:19:20.737904 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:20.737537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfn7w" event={"ID":"0b405716-04dd-4c5f-9ed2-54631a55ab26","Type":"ContainerStarted","Data":"c7c004baa4bc7acf8373fbc3f1fd4c63a0f5b0c938b6eca584c07e38d7ed296f"} Jun 09 01:19:20.757460 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:19:20.757415 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cfn7w" podStartSLOduration=2.747814644 podStartE2EDuration="3.757402012s" totalImagesPullingTime="947.023759ms" totalInitContainerRuntime="62.563609ms" isStatefulPod=true podCreationTimestamp="2026-06-09 01:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:20.756664294 +0000 UTC m=+204.109976619" watchObservedRunningTime="2026-06-09 01:19:20.757402012 +0000 UTC m=+204.110714365" Jun 09 01:20:06.168921 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:06.168866 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" podUID="1588bcbd-8f91-4d6a-8960-040c05fc560d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 01:20:08.885137 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:08.885108 2576 generic.go:356] "Generic (PLEG): container finished" podID="dcd39cff-b62a-4f55-946d-2d4d5269b82a" containerID="43ebcea0948cf7ac72627a3f242348013cd50fee5888a809fbf5dcfa2bb502b8" exitCode=0 Jun 09 01:20:08.885467 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:08.885185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" event={"ID":"dcd39cff-b62a-4f55-946d-2d4d5269b82a","Type":"ContainerDied","Data":"43ebcea0948cf7ac72627a3f242348013cd50fee5888a809fbf5dcfa2bb502b8"} Jun 09 01:20:08.885509 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:08.885468 2576 scope.go:117] "RemoveContainer" containerID="43ebcea0948cf7ac72627a3f242348013cd50fee5888a809fbf5dcfa2bb502b8" Jun 09 01:20:08.972203 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:08.972166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:20:08.974630 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:08.974603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e649f-3a27-4ccf-93c3-8bc1398f1136-metrics-certs\") pod \"network-metrics-daemon-89hqz\" (UID: \"469e649f-3a27-4ccf-93c3-8bc1398f1136\") " pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:20:09.095411 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:09.095386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pwvx\"" Jun 09 01:20:09.103680 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:09.103664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89hqz" Jun 09 01:20:09.226167 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:09.226121 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89hqz"] Jun 09 01:20:09.228738 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:20:09.228709 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469e649f_3a27_4ccf_93c3_8bc1398f1136.slice/crio-9943430962f16525d8255164f3b17820501dfa3d4b14e2f0a26ff690a7daa24e WatchSource:0}: Error finding container 9943430962f16525d8255164f3b17820501dfa3d4b14e2f0a26ff690a7daa24e: Status 404 returned error can't find the container with id 9943430962f16525d8255164f3b17820501dfa3d4b14e2f0a26ff690a7daa24e Jun 09 01:20:09.890302 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:09.890264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89hqz" event={"ID":"469e649f-3a27-4ccf-93c3-8bc1398f1136","Type":"ContainerStarted","Data":"9943430962f16525d8255164f3b17820501dfa3d4b14e2f0a26ff690a7daa24e"} Jun 09 01:20:09.892201 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:09.892166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r24h4" event={"ID":"dcd39cff-b62a-4f55-946d-2d4d5269b82a","Type":"ContainerStarted","Data":"26ed5d2a941b3457fa0a49e28136e0597d0ce95ccd53a1a3c491a0dd43963774"} Jun 09 01:20:10.897334 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:10.897293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89hqz" event={"ID":"469e649f-3a27-4ccf-93c3-8bc1398f1136","Type":"ContainerStarted","Data":"7954e2fc1e10f746967790e9dc457a95360073be53af10d23d0fd5de9d139a0b"} Jun 09 01:20:10.897808 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:10.897359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89hqz" event={"ID":"469e649f-3a27-4ccf-93c3-8bc1398f1136","Type":"ContainerStarted","Data":"5c7e831f58ff6eb3ef96a3046bee3dc80047ac1c908ebc52feaee14582840788"} Jun 09 01:20:10.913578 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:10.913538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-89hqz" podStartSLOduration=252.863769608 podStartE2EDuration="4m13.913523222s" totalImagesPullingTime="1.049753614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:20:10.912249306 +0000 UTC m=+254.265561630" watchObservedRunningTime="2026-06-09 01:20:10.913523222 +0000 UTC m=+254.266835546" Jun 09 01:20:16.168343 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:16.168300 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" podUID="1588bcbd-8f91-4d6a-8960-040c05fc560d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 01:20:26.168177 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.168138 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" podUID="1588bcbd-8f91-4d6a-8960-040c05fc560d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 01:20:26.168642 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.168225 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" Jun 09 01:20:26.168822 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.168789 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0db3ffa0661a3bdc744902d969aa3be37f372869767f6c1d29291bcb1dacb8a9"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 01:20:26.168898 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.168851 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" podUID="1588bcbd-8f91-4d6a-8960-040c05fc560d" containerName="service-proxy" containerID="cri-o://0db3ffa0661a3bdc744902d969aa3be37f372869767f6c1d29291bcb1dacb8a9" gracePeriod=30 Jun 09 01:20:26.950648 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.950615 2576 generic.go:356] "Generic (PLEG): container finished" podID="1588bcbd-8f91-4d6a-8960-040c05fc560d" containerID="0db3ffa0661a3bdc744902d969aa3be37f372869767f6c1d29291bcb1dacb8a9" exitCode=2 Jun 09 01:20:26.950833 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.950680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerDied","Data":"0db3ffa0661a3bdc744902d969aa3be37f372869767f6c1d29291bcb1dacb8a9"} Jun 09 01:20:26.950833 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:26.950719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df74b54cd-zjdkt" event={"ID":"1588bcbd-8f91-4d6a-8960-040c05fc560d","Type":"ContainerStarted","Data":"4f2cf44ad5425c32e4f60388234213152c8373cdcea1602399f1d5c01dab0efb"} Jun 09 01:20:38.570474 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:20:38.570420 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d6js2" podUID="50d0cea5-f5be-4c7d-8d25-294bac0dcde6" Jun 09 01:20:38.988144 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:38.988116 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:41.491006 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.490972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:41.493155 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.493136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50d0cea5-f5be-4c7d-8d25-294bac0dcde6-metrics-tls\") pod \"dns-default-d6js2\" (UID: \"50d0cea5-f5be-4c7d-8d25-294bac0dcde6\") " pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:41.691430 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.691396 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9cpl\"" Jun 09 01:20:41.699684 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.699662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:41.819879 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.819699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6js2"] Jun 09 01:20:41.822262 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:20:41.822233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d0cea5_f5be_4c7d_8d25_294bac0dcde6.slice/crio-2b5e31ebd26824b89d24600a421453ddc1864028d0c5542a04006bae01a28924 WatchSource:0}: Error finding container 2b5e31ebd26824b89d24600a421453ddc1864028d0c5542a04006bae01a28924: Status 404 returned error can't find the container with id 2b5e31ebd26824b89d24600a421453ddc1864028d0c5542a04006bae01a28924 Jun 09 01:20:41.999174 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:41.999098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6js2" event={"ID":"50d0cea5-f5be-4c7d-8d25-294bac0dcde6","Type":"ContainerStarted","Data":"2b5e31ebd26824b89d24600a421453ddc1864028d0c5542a04006bae01a28924"} Jun 09 01:20:43.610147 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:43.610106 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" podUID="4abcd9be-6a0e-479c-853c-38d5859a97a6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.10:8000/readyz\": dial tcp 10.134.0.10:8000: connect: connection refused" Jun 09 01:20:44.007077 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.007045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6js2" event={"ID":"50d0cea5-f5be-4c7d-8d25-294bac0dcde6","Type":"ContainerStarted","Data":"c6bf85909f94f407a89bf93d570545e5b90dee07129a82bf27b5e7ca725016cd"} Jun 09 01:20:44.007251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.007105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6js2" event={"ID":"50d0cea5-f5be-4c7d-8d25-294bac0dcde6","Type":"ContainerStarted","Data":"62f0271f8651db506dbb0e27d9cc1dc7acd2238f3288aafed54d506be05de425"} Jun 09 01:20:44.007251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.007217 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:44.008480 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.008452 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ea80f95-b679-4647-a5ea-62e2840f5c0c" containerID="30d4c9b6c0e004bb298aed9d69fbd643b62962d0debe0854ef78fa88a66e4bf2" exitCode=255 Jun 09 01:20:44.008602 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.008517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" event={"ID":"6ea80f95-b679-4647-a5ea-62e2840f5c0c","Type":"ContainerDied","Data":"30d4c9b6c0e004bb298aed9d69fbd643b62962d0debe0854ef78fa88a66e4bf2"} Jun 09 01:20:44.008798 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.008752 2576 scope.go:117] "RemoveContainer" containerID="30d4c9b6c0e004bb298aed9d69fbd643b62962d0debe0854ef78fa88a66e4bf2" Jun 09 01:20:44.010044 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.010022 2576 generic.go:356] "Generic (PLEG): container finished" podID="4abcd9be-6a0e-479c-853c-38d5859a97a6" containerID="25cca085c3bca594a6a906ce4e1095ec0782f2fe25348bbbf01b24e6665ec13d" exitCode=1 Jun 09 01:20:44.010130 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.010052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" event={"ID":"4abcd9be-6a0e-479c-853c-38d5859a97a6","Type":"ContainerDied","Data":"25cca085c3bca594a6a906ce4e1095ec0782f2fe25348bbbf01b24e6665ec13d"} Jun 09 01:20:44.010297 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.010285 2576 scope.go:117] "RemoveContainer" containerID="25cca085c3bca594a6a906ce4e1095ec0782f2fe25348bbbf01b24e6665ec13d" Jun 09 01:20:44.023809 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:44.023732 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d6js2" podStartSLOduration=251.107715129 podStartE2EDuration="4m13.02371601s" totalImagesPullingTime="1.916000881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:20:44.022945717 +0000 UTC m=+287.376258043" watchObservedRunningTime="2026-06-09 01:20:44.02371601 +0000 UTC m=+287.377028332" Jun 09 01:20:45.014957 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:45.014923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" event={"ID":"4abcd9be-6a0e-479c-853c-38d5859a97a6","Type":"ContainerStarted","Data":"a945146148ec92751cedaf9ec2acf816c501829f02a1f0691c74aeea14c352b7"} Jun 09 01:20:45.015396 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:45.015201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:20:45.015857 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:45.015833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5865796854-ws5dt" Jun 09 01:20:45.016740 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:45.016719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f9765d56-mh2c9" event={"ID":"6ea80f95-b679-4647-a5ea-62e2840f5c0c","Type":"ContainerStarted","Data":"5b0022e7ceba6d8896b270c9673fb93b7bfc3fce102b887208df3ad1cd123562"} Jun 09 01:20:54.019208 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:54.019179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d6js2" Jun 09 01:20:57.042102 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:57.042072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:20:57.042545 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:57.042113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:20:57.046359 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:20:57.046340 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 01:22:57.398657 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.398621 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9"] Jun 09 01:22:57.401781 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.401747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.404379 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.404354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 01:22:57.404527 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.404436 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 01:22:57.404527 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.404437 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 01:22:57.404527 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.404481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sf295\"" Jun 09 01:22:57.404704 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.404537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 01:22:57.415971 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.415947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9"] Jun 09 01:22:57.472778 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.472730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6x9q\" (UniqueName: \"kubernetes.io/projected/16056cec-60bf-46ae-a79f-2dabe0895c23-kube-api-access-p6x9q\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.472918 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.472794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.472918 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.472840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.473007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.472921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.473007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.472952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.573984 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.573949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.574138 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.573993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.574138 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.574113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x9q\" (UniqueName: \"kubernetes.io/projected/16056cec-60bf-46ae-a79f-2dabe0895c23-kube-api-access-p6x9q\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.574250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.574153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.574250 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.574181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.574390 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.574368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.576309 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.576281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16056cec-60bf-46ae-a79f-2dabe0895c23-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.576510 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.576490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.576647 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.576628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16056cec-60bf-46ae-a79f-2dabe0895c23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.582402 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.582379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6x9q\" (UniqueName: \"kubernetes.io/projected/16056cec-60bf-46ae-a79f-2dabe0895c23-kube-api-access-p6x9q\") pod \"opendatahub-operator-controller-manager-7c5668658c-p7jp9\" (UID: \"16056cec-60bf-46ae-a79f-2dabe0895c23\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.712059 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.711982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:22:57.845594 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.845557 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9"] Jun 09 01:22:57.848424 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:22:57.848397 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16056cec_60bf_46ae_a79f_2dabe0895c23.slice/crio-4ab27a3199e588b66e62ab3ea9f73bba26d6052619fc71ae304662ae8bb5d16e WatchSource:0}: Error finding container 4ab27a3199e588b66e62ab3ea9f73bba26d6052619fc71ae304662ae8bb5d16e: Status 404 returned error can't find the container with id 4ab27a3199e588b66e62ab3ea9f73bba26d6052619fc71ae304662ae8bb5d16e Jun 09 01:22:57.850262 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:57.850241 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:22:58.445914 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:22:58.445874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" event={"ID":"16056cec-60bf-46ae-a79f-2dabe0895c23","Type":"ContainerStarted","Data":"4ab27a3199e588b66e62ab3ea9f73bba26d6052619fc71ae304662ae8bb5d16e"} Jun 09 01:23:01.458579 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:01.458540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" event={"ID":"16056cec-60bf-46ae-a79f-2dabe0895c23","Type":"ContainerStarted","Data":"6ea96ab963d6911a1fbc973ddbbfaa08e94eedef6c03483c5683d6afab605230"} Jun 09 01:23:02.463321 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:02.463280 2576 generic.go:356] "Generic (PLEG): container finished" podID="16056cec-60bf-46ae-a79f-2dabe0895c23" containerID="6ea96ab963d6911a1fbc973ddbbfaa08e94eedef6c03483c5683d6afab605230" exitCode=0 Jun 09 01:23:02.463674 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:02.463338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" event={"ID":"16056cec-60bf-46ae-a79f-2dabe0895c23","Type":"ContainerDied","Data":"6ea96ab963d6911a1fbc973ddbbfaa08e94eedef6c03483c5683d6afab605230"} Jun 09 01:23:03.468374 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:03.468337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" event={"ID":"16056cec-60bf-46ae-a79f-2dabe0895c23","Type":"ContainerStarted","Data":"63a8880d46f9ba12102768fba4400b67c25d778a85339f32eec0ad854d6e7721"} Jun 09 01:23:03.468776 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:03.468495 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:23:03.489393 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:03.489339 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" podStartSLOduration=2.23324679 podStartE2EDuration="6.489321655s" totalImagesPullingTime="3.306471125s" totalInitContainerRuntime="949.60374ms" isStatefulPod=false podCreationTimestamp="2026-06-09 01:22:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:03.487525422 +0000 UTC m=+426.840837746" watchObservedRunningTime="2026-06-09 01:23:03.489321655 +0000 UTC m=+426.842633981" Jun 09 01:23:14.473408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:14.473333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-p7jp9" Jun 09 01:23:15.182081 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.182050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq"] Jun 09 01:23:15.187342 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.187321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.190016 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.189997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 01:23:15.190145 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.190036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 01:23:15.191282 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.191262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:23:15.191399 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.191379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bn7nq\"" Jun 09 01:23:15.191464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.191397 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 01:23:15.191464 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.191393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 01:23:15.196607 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.196584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq"] Jun 09 01:23:15.293304 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.293269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.293453 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.293311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9bc65bfd-b49c-4366-9d2d-bfa2208457df-manager-config\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.293453 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.293373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t25p2\" (UniqueName: \"kubernetes.io/projected/9bc65bfd-b49c-4366-9d2d-bfa2208457df-kube-api-access-t25p2\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.293453 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.293414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.393897 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.393861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.394053 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.393913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9bc65bfd-b49c-4366-9d2d-bfa2208457df-manager-config\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.394053 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.393943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t25p2\" (UniqueName: \"kubernetes.io/projected/9bc65bfd-b49c-4366-9d2d-bfa2208457df-kube-api-access-t25p2\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.394053 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.393967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.394612 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.394584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9bc65bfd-b49c-4366-9d2d-bfa2208457df-manager-config\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.396368 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.396346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.396484 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.396415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bc65bfd-b49c-4366-9d2d-bfa2208457df-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.420032 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.419999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t25p2\" (UniqueName: \"kubernetes.io/projected/9bc65bfd-b49c-4366-9d2d-bfa2208457df-kube-api-access-t25p2\") pod \"lws-controller-manager-586b6bddf9-bh8dq\" (UID: \"9bc65bfd-b49c-4366-9d2d-bfa2208457df\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.496631 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.496571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:15.630494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:15.630466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq"] Jun 09 01:23:15.633800 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:23:15.633778 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc65bfd_b49c_4366_9d2d_bfa2208457df.slice/crio-12f700e8a17a37518656ed16a6b3e6473e555b64377e1b1cda861acf5d098cff WatchSource:0}: Error finding container 12f700e8a17a37518656ed16a6b3e6473e555b64377e1b1cda861acf5d098cff: Status 404 returned error can't find the container with id 12f700e8a17a37518656ed16a6b3e6473e555b64377e1b1cda861acf5d098cff Jun 09 01:23:16.511140 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:16.511093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" event={"ID":"9bc65bfd-b49c-4366-9d2d-bfa2208457df","Type":"ContainerStarted","Data":"12f700e8a17a37518656ed16a6b3e6473e555b64377e1b1cda861acf5d098cff"} Jun 09 01:23:19.522675 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:19.522635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" event={"ID":"9bc65bfd-b49c-4366-9d2d-bfa2208457df","Type":"ContainerStarted","Data":"7f52cca900fdb27172199cd23ae146ae560aa0a124754ea5d2005389b147382f"} Jun 09 01:23:19.523050 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:19.522784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:19.538541 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:19.538495 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" podStartSLOduration=1.700926714 podStartE2EDuration="4.538484306s" totalImagesPullingTime="2.837557592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:19.537678455 +0000 UTC m=+442.890990780" watchObservedRunningTime="2026-06-09 01:23:19.538484306 +0000 UTC m=+442.891796629" Jun 09 01:23:26.736738 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.736707 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c846984dd-mscx5"] Jun 09 01:23:26.739599 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.739582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.744975 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.744951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 01:23:26.744975 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.744962 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 01:23:26.745155 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.744994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 01:23:26.745343 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.745326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 01:23:26.745399 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.745351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wl4bz\"" Jun 09 01:23:26.762524 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.762504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c846984dd-mscx5"] Jun 09 01:23:26.776523 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.776503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.776630 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.776534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2l2\" (UniqueName: \"kubernetes.io/projected/a9e6a719-71bb-4b65-9963-7050f9658dbb-kube-api-access-lr2l2\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.776630 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.776556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9e6a719-71bb-4b65-9963-7050f9658dbb-tmp\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.877909 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.877880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.878056 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.877916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2l2\" (UniqueName: \"kubernetes.io/projected/a9e6a719-71bb-4b65-9963-7050f9658dbb-kube-api-access-lr2l2\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.878056 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.877937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9e6a719-71bb-4b65-9963-7050f9658dbb-tmp\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.878056 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:23:26.878022 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 01:23:26.878154 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:23:26.878093 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs podName:a9e6a719-71bb-4b65-9963-7050f9658dbb nodeName:}" failed. No retries permitted until 2026-06-09 01:23:27.378075983 +0000 UTC m=+450.731388296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs") pod "kube-auth-proxy-7c846984dd-mscx5" (UID: "a9e6a719-71bb-4b65-9963-7050f9658dbb") : secret "kube-auth-proxy-tls" not found Jun 09 01:23:26.879978 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.879950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9e6a719-71bb-4b65-9963-7050f9658dbb-tmp\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:26.887453 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:26.887420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2l2\" (UniqueName: \"kubernetes.io/projected/a9e6a719-71bb-4b65-9963-7050f9658dbb-kube-api-access-lr2l2\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:27.380491 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:27.380454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:27.382821 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:27.382801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e6a719-71bb-4b65-9963-7050f9658dbb-tls-certs\") pod \"kube-auth-proxy-7c846984dd-mscx5\" (UID: \"a9e6a719-71bb-4b65-9963-7050f9658dbb\") " pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:27.650308 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:27.650224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" Jun 09 01:23:27.774573 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:27.774542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c846984dd-mscx5"] Jun 09 01:23:27.777017 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:23:27.776990 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e6a719_71bb_4b65_9963_7050f9658dbb.slice/crio-22c4123fe30eb2e1fdec0d6bf95324177ad156d01c55181fe46e47eda10de523 WatchSource:0}: Error finding container 22c4123fe30eb2e1fdec0d6bf95324177ad156d01c55181fe46e47eda10de523: Status 404 returned error can't find the container with id 22c4123fe30eb2e1fdec0d6bf95324177ad156d01c55181fe46e47eda10de523 Jun 09 01:23:28.554257 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:28.554215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" event={"ID":"a9e6a719-71bb-4b65-9963-7050f9658dbb","Type":"ContainerStarted","Data":"22c4123fe30eb2e1fdec0d6bf95324177ad156d01c55181fe46e47eda10de523"} Jun 09 01:23:30.528318 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:30.528285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-bh8dq" Jun 09 01:23:31.572968 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:31.572928 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" event={"ID":"a9e6a719-71bb-4b65-9963-7050f9658dbb","Type":"ContainerStarted","Data":"3def1fd2a9672bd6490da9eb2d66a958a7182f6f7a732241d5910ebd9613be81"} Jun 09 01:23:31.590154 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:23:31.590105 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c846984dd-mscx5" podStartSLOduration=2.40014563 podStartE2EDuration="5.590091602s" totalImagesPullingTime="3.189945972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:31.589943674 +0000 UTC m=+454.943255999" watchObservedRunningTime="2026-06-09 01:23:31.590091602 +0000 UTC m=+454.943403976" Jun 09 01:24:59.095798 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.095715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm"] Jun 09 01:24:59.098358 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.098338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:24:59.103648 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.103623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 01:24:59.105028 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.104855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 01:24:59.105028 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.104864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fttjq\"" Jun 09 01:24:59.105028 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.104898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 01:24:59.112215 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.112193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm"] Jun 09 01:24:59.137385 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.137359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7g4\" (UniqueName: \"kubernetes.io/projected/7e2b8049-b6eb-4961-a26a-45d88a339cf4-kube-api-access-xb7g4\") pod \"dns-operator-controller-manager-864dd78c4c-c9hcm\" (UID: \"7e2b8049-b6eb-4961-a26a-45d88a339cf4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:24:59.238220 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.238187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7g4\" (UniqueName: \"kubernetes.io/projected/7e2b8049-b6eb-4961-a26a-45d88a339cf4-kube-api-access-xb7g4\") pod \"dns-operator-controller-manager-864dd78c4c-c9hcm\" (UID: \"7e2b8049-b6eb-4961-a26a-45d88a339cf4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:24:59.247339 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.247320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7g4\" (UniqueName: \"kubernetes.io/projected/7e2b8049-b6eb-4961-a26a-45d88a339cf4-kube-api-access-xb7g4\") pod \"dns-operator-controller-manager-864dd78c4c-c9hcm\" (UID: \"7e2b8049-b6eb-4961-a26a-45d88a339cf4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:24:59.408095 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.408023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:24:59.531326 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.531292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm"] Jun 09 01:24:59.534411 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:24:59.534379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2b8049_b6eb_4961_a26a_45d88a339cf4.slice/crio-c60ef9e4a82e6eb71f336c1c365d03ff0a514428db08a9cb6a802e018d046244 WatchSource:0}: Error finding container c60ef9e4a82e6eb71f336c1c365d03ff0a514428db08a9cb6a802e018d046244: Status 404 returned error can't find the container with id c60ef9e4a82e6eb71f336c1c365d03ff0a514428db08a9cb6a802e018d046244 Jun 09 01:24:59.871352 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:24:59.871318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" event={"ID":"7e2b8049-b6eb-4961-a26a-45d88a339cf4","Type":"ContainerStarted","Data":"c60ef9e4a82e6eb71f336c1c365d03ff0a514428db08a9cb6a802e018d046244"} Jun 09 01:25:01.568251 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.568223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc"] Jun 09 01:25:01.571628 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.571597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.574287 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.574262 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f84hw\"" Jun 09 01:25:01.574395 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.574262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 01:25:01.574395 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.574262 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 01:25:01.580017 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.579612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc"] Jun 09 01:25:01.656408 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.656377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5d4647af-a6ad-46c9-a384-85afa19be4be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.656570 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.656443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wspsh\" (UniqueName: \"kubernetes.io/projected/5d4647af-a6ad-46c9-a384-85afa19be4be-kube-api-access-wspsh\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.656570 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.656483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.757356 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.757331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5d4647af-a6ad-46c9-a384-85afa19be4be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.757473 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.757394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wspsh\" (UniqueName: \"kubernetes.io/projected/5d4647af-a6ad-46c9-a384-85afa19be4be-kube-api-access-wspsh\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.757473 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.757411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.757581 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:25:01.757494 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 01:25:01.757581 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:25:01.757540 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert podName:5d4647af-a6ad-46c9-a384-85afa19be4be nodeName:}" failed. No retries permitted until 2026-06-09 01:25:02.25752422 +0000 UTC m=+545.610836522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-qxxdc" (UID: "5d4647af-a6ad-46c9-a384-85afa19be4be") : secret "plugin-serving-cert" not found Jun 09 01:25:01.757903 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.757886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5d4647af-a6ad-46c9-a384-85afa19be4be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.765573 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.765549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wspsh\" (UniqueName: \"kubernetes.io/projected/5d4647af-a6ad-46c9-a384-85afa19be4be-kube-api-access-wspsh\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:01.881526 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.881487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" event={"ID":"7e2b8049-b6eb-4961-a26a-45d88a339cf4","Type":"ContainerStarted","Data":"27c5b413a83a26fb49973cb063c11437725b7d17de3ba85d88794880aaac408f"} Jun 09 01:25:01.881720 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.881617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:25:01.901091 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:01.901029 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" podStartSLOduration=0.752954581 podStartE2EDuration="2.901015165s" totalImagesPullingTime="2.148060584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:01.899797343 +0000 UTC m=+545.253109661" watchObservedRunningTime="2026-06-09 01:25:01.901015165 +0000 UTC m=+545.254327488" Jun 09 01:25:02.260579 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:02.260481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:02.262867 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:02.262846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4647af-a6ad-46c9-a384-85afa19be4be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qxxdc\" (UID: \"5d4647af-a6ad-46c9-a384-85afa19be4be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:02.483169 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:02.483124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" Jun 09 01:25:02.608204 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:02.608171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc"] Jun 09 01:25:02.611597 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:25:02.611572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d4647af_a6ad_46c9_a384_85afa19be4be.slice/crio-cc5058af814c99c32e2eca68984018dda9218ad4786eb106b3a4de1e0b54c68c WatchSource:0}: Error finding container cc5058af814c99c32e2eca68984018dda9218ad4786eb106b3a4de1e0b54c68c: Status 404 returned error can't find the container with id cc5058af814c99c32e2eca68984018dda9218ad4786eb106b3a4de1e0b54c68c Jun 09 01:25:02.886393 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:02.886356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" event={"ID":"5d4647af-a6ad-46c9-a384-85afa19be4be","Type":"ContainerStarted","Data":"cc5058af814c99c32e2eca68984018dda9218ad4786eb106b3a4de1e0b54c68c"} Jun 09 01:25:12.889150 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:12.889112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9hcm" Jun 09 01:25:26.988052 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:26.988017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" event={"ID":"5d4647af-a6ad-46c9-a384-85afa19be4be","Type":"ContainerStarted","Data":"bd861cc3e70cd4ef3a2397119870860f833fd0e26016ea3aa076ffaa2dda56e3"} Jun 09 01:25:27.003046 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:27.002994 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qxxdc" podStartSLOduration=2.617061829 podStartE2EDuration="26.002979338s" totalImagesPullingTime="23.385917509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:27.002676296 +0000 UTC m=+570.355988622" watchObservedRunningTime="2026-06-09 01:25:27.002979338 +0000 UTC m=+570.356291661" Jun 09 01:25:54.806172 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.806137 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:25:54.846121 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.846089 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:25:54.846272 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.846181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:25:54.848700 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.848678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kx4wb\"" Jun 09 01:25:54.973188 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.973146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xglvp\" (UniqueName: \"kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp\") pod \"authorino-58cd955675-ff9qr\" (UID: \"e6d2d27c-e53f-4a33-acf8-1e4b678421a2\") " pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:25:54.985717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.985690 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:25:54.988731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.988715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:25:54.996400 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:54.996375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:25:55.074401 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.074327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xglvp\" (UniqueName: \"kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp\") pod \"authorino-58cd955675-ff9qr\" (UID: \"e6d2d27c-e53f-4a33-acf8-1e4b678421a2\") " pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:25:55.081669 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.081646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xglvp\" (UniqueName: \"kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp\") pod \"authorino-58cd955675-ff9qr\" (UID: \"e6d2d27c-e53f-4a33-acf8-1e4b678421a2\") " pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:25:55.154975 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.154941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:25:55.175086 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.175055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbl92\" (UniqueName: \"kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92\") pod \"authorino-75d556bd77-czjzd\" (UID: \"dc99743e-de83-4ba0-a158-4c5586942307\") " pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:25:55.275219 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.275195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:25:55.275482 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.275460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbl92\" (UniqueName: \"kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92\") pod \"authorino-75d556bd77-czjzd\" (UID: \"dc99743e-de83-4ba0-a158-4c5586942307\") " pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:25:55.277553 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:25:55.277528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6d2d27c_e53f_4a33_acf8_1e4b678421a2.slice/crio-9d678318f4db0de14d2c782c70bc3e1054272bc020e79980d68633e817990d2a WatchSource:0}: Error finding container 9d678318f4db0de14d2c782c70bc3e1054272bc020e79980d68633e817990d2a: Status 404 returned error can't find the container with id 9d678318f4db0de14d2c782c70bc3e1054272bc020e79980d68633e817990d2a Jun 09 01:25:55.283017 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.282994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbl92\" (UniqueName: \"kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92\") pod \"authorino-75d556bd77-czjzd\" (UID: \"dc99743e-de83-4ba0-a158-4c5586942307\") " pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:25:55.297220 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.297199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:25:55.420582 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:55.420520 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:25:55.423020 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:25:55.422999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc99743e_de83_4ba0_a158_4c5586942307.slice/crio-8c763fdbc638796c5e88fc748c2d6f600ad245d69aaa8f4c7a3037bf3b4f83be WatchSource:0}: Error finding container 8c763fdbc638796c5e88fc748c2d6f600ad245d69aaa8f4c7a3037bf3b4f83be: Status 404 returned error can't find the container with id 8c763fdbc638796c5e88fc748c2d6f600ad245d69aaa8f4c7a3037bf3b4f83be Jun 09 01:25:56.103684 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:56.103646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-czjzd" event={"ID":"dc99743e-de83-4ba0-a158-4c5586942307","Type":"ContainerStarted","Data":"8c763fdbc638796c5e88fc748c2d6f600ad245d69aaa8f4c7a3037bf3b4f83be"} Jun 09 01:25:56.105032 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:56.105005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ff9qr" event={"ID":"e6d2d27c-e53f-4a33-acf8-1e4b678421a2","Type":"ContainerStarted","Data":"9d678318f4db0de14d2c782c70bc3e1054272bc020e79980d68633e817990d2a"} Jun 09 01:25:57.077068 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:57.076972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:25:57.077328 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:57.077255 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:25:59.119714 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:59.119676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-czjzd" event={"ID":"dc99743e-de83-4ba0-a158-4c5586942307","Type":"ContainerStarted","Data":"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be"} Jun 09 01:25:59.121122 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:59.121100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ff9qr" event={"ID":"e6d2d27c-e53f-4a33-acf8-1e4b678421a2","Type":"ContainerStarted","Data":"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b"} Jun 09 01:25:59.135816 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:59.135775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-czjzd" podStartSLOduration=1.646821272 podStartE2EDuration="5.135746743s" totalImagesPullingTime="3.488925471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:59.134830141 +0000 UTC m=+602.488142485" watchObservedRunningTime="2026-06-09 01:25:59.135746743 +0000 UTC m=+602.489059091" Jun 09 01:25:59.150049 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:59.149996 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ff9qr" podStartSLOduration=1.526292395 podStartE2EDuration="5.149976623s" totalImagesPullingTime="3.623684228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:59.149102793 +0000 UTC m=+602.502415140" watchObservedRunningTime="2026-06-09 01:25:59.149976623 +0000 UTC m=+602.503288949" Jun 09 01:25:59.172277 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:25:59.172217 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:26:01.127982 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:01.127939 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ff9qr" podUID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" containerName="authorino" containerID="cri-o://df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b" gracePeriod=30 Jun 09 01:26:01.364061 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:01.364036 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:26:01.425073 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:01.425001 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xglvp\" (UniqueName: \"kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp\") pod \"e6d2d27c-e53f-4a33-acf8-1e4b678421a2\" (UID: \"e6d2d27c-e53f-4a33-acf8-1e4b678421a2\") " Jun 09 01:26:01.427094 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:01.427064 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp" (OuterVolumeSpecName: "kube-api-access-xglvp") pod "e6d2d27c-e53f-4a33-acf8-1e4b678421a2" (UID: "e6d2d27c-e53f-4a33-acf8-1e4b678421a2"). InnerVolumeSpecName "kube-api-access-xglvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:26:01.526016 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:01.525976 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xglvp\" (UniqueName: \"kubernetes.io/projected/e6d2d27c-e53f-4a33-acf8-1e4b678421a2-kube-api-access-xglvp\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:26:02.133276 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.133244 2576 generic.go:356] "Generic (PLEG): container finished" podID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" containerID="df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b" exitCode=0 Jun 09 01:26:02.133654 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.133291 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ff9qr" Jun 09 01:26:02.133654 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.133324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ff9qr" event={"ID":"e6d2d27c-e53f-4a33-acf8-1e4b678421a2","Type":"ContainerDied","Data":"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b"} Jun 09 01:26:02.133654 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.133362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ff9qr" event={"ID":"e6d2d27c-e53f-4a33-acf8-1e4b678421a2","Type":"ContainerDied","Data":"9d678318f4db0de14d2c782c70bc3e1054272bc020e79980d68633e817990d2a"} Jun 09 01:26:02.133654 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.133389 2576 scope.go:117] "RemoveContainer" containerID="df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b" Jun 09 01:26:02.142343 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.142325 2576 scope.go:117] "RemoveContainer" containerID="df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b" Jun 09 01:26:02.142587 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:26:02.142566 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b\": container with ID starting with df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b not found: ID does not exist" containerID="df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b" Jun 09 01:26:02.142638 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.142595 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b"} err="failed to get container status \"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b\": rpc error: code = NotFound desc = could not find container \"df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b\": container with ID starting with df0c878b5e6e247ed5b463314979665ff32b0f32da8c1d31d76ef3360c5bae7b not found: ID does not exist" Jun 09 01:26:02.155652 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.155630 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:26:02.158886 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:02.158868 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ff9qr"] Jun 09 01:26:03.096987 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:03.096957 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" path="/var/lib/kubelet/pods/e6d2d27c-e53f-4a33-acf8-1e4b678421a2/volumes" Jun 09 01:26:29.269771 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.269733 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bxp9w"] Jun 09 01:26:29.270235 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.270016 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" containerName="authorino" Jun 09 01:26:29.270235 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.270030 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" containerName="authorino" Jun 09 01:26:29.270235 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.270085 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6d2d27c-e53f-4a33-acf8-1e4b678421a2" containerName="authorino" Jun 09 01:26:29.273008 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.272990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" Jun 09 01:26:29.275724 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.275698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 01:26:29.275839 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.275701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 01:26:29.275839 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.275779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-k9g9t\"" Jun 09 01:26:29.281159 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.281137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bxp9w"] Jun 09 01:26:29.327716 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.327686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4c7z\" (UniqueName: \"kubernetes.io/projected/6a54b173-7c97-4cf2-91db-ef85d54b580b-kube-api-access-p4c7z\") pod \"keycloak-operator-d67dbbb48-bxp9w\" (UID: \"6a54b173-7c97-4cf2-91db-ef85d54b580b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" Jun 09 01:26:29.428072 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.428038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4c7z\" (UniqueName: \"kubernetes.io/projected/6a54b173-7c97-4cf2-91db-ef85d54b580b-kube-api-access-p4c7z\") pod \"keycloak-operator-d67dbbb48-bxp9w\" (UID: \"6a54b173-7c97-4cf2-91db-ef85d54b580b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" Jun 09 01:26:29.439456 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.439426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4c7z\" (UniqueName: \"kubernetes.io/projected/6a54b173-7c97-4cf2-91db-ef85d54b580b-kube-api-access-p4c7z\") pod \"keycloak-operator-d67dbbb48-bxp9w\" (UID: \"6a54b173-7c97-4cf2-91db-ef85d54b580b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" Jun 09 01:26:29.583189 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.583125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" Jun 09 01:26:29.705427 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:29.705360 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bxp9w"] Jun 09 01:26:29.707988 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:26:29.707951 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a54b173_7c97_4cf2_91db_ef85d54b580b.slice/crio-34dfc3e651bd0af6b20e3c99ef52d5ecc9b9111a0701ce527b1915d0588deabc WatchSource:0}: Error finding container 34dfc3e651bd0af6b20e3c99ef52d5ecc9b9111a0701ce527b1915d0588deabc: Status 404 returned error can't find the container with id 34dfc3e651bd0af6b20e3c99ef52d5ecc9b9111a0701ce527b1915d0588deabc Jun 09 01:26:30.242801 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:30.242770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" event={"ID":"6a54b173-7c97-4cf2-91db-ef85d54b580b","Type":"ContainerStarted","Data":"34dfc3e651bd0af6b20e3c99ef52d5ecc9b9111a0701ce527b1915d0588deabc"} Jun 09 01:26:36.271866 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:36.271831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" event={"ID":"6a54b173-7c97-4cf2-91db-ef85d54b580b","Type":"ContainerStarted","Data":"f9e44aa9c2a6200595599c45fc26eaa94964e468fe21faf152146a87bee445a8"} Jun 09 01:26:36.289415 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:26:36.289368 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-bxp9w" podStartSLOduration=1.524907642 podStartE2EDuration="7.289353207s" totalImagesPullingTime="5.764445565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:26:36.287650157 +0000 UTC m=+639.640962475" watchObservedRunningTime="2026-06-09 01:26:36.289353207 +0000 UTC m=+639.642665530" Jun 09 01:27:14.595735 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.595706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gn9mt"] Jun 09 01:27:14.597699 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.597683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:14.605748 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.605721 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gn9mt"] Jun 09 01:27:14.769501 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.769469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956wq\" (UniqueName: \"kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq\") pod \"authorino-5d4b67c446-gn9mt\" (UID: \"c01c40be-89a5-47a8-ac12-da67eff2e643\") " pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:14.787434 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.787403 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gn9mt"] Jun 09 01:27:14.787632 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:27:14.787608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-956wq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-gn9mt" podUID="c01c40be-89a5-47a8-ac12-da67eff2e643" Jun 09 01:27:14.819130 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.817127 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-qtkqv"] Jun 09 01:27:14.820363 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.820339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:14.823271 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.823252 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 01:27:14.826971 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.826809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-qtkqv"] Jun 09 01:27:14.849701 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.849641 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qtkqv"] Jun 09 01:27:14.849850 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:27:14.849830 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q48v2 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-q48v2 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-qtkqv" podUID="6aa04a46-1524-40b2-9c1e-d18576a35c93" Jun 09 01:27:14.870319 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.870297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956wq\" (UniqueName: \"kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq\") pod \"authorino-5d4b67c446-gn9mt\" (UID: \"c01c40be-89a5-47a8-ac12-da67eff2e643\") " pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:14.876674 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.876644 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:27:14.879863 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.879845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:14.879976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.879848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-956wq\" (UniqueName: \"kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq\") pod \"authorino-5d4b67c446-gn9mt\" (UID: \"c01c40be-89a5-47a8-ac12-da67eff2e643\") " pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:14.886547 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.886525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:27:14.971157 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.971125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:14.971301 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.971167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffn99\" (UniqueName: \"kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:14.971301 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.971236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:14.971301 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:14.971270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q48v2\" (UniqueName: \"kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.072439 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.072412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.072563 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.072449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffn99\" (UniqueName: \"kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:15.072606 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.072569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:15.072667 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.072612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q48v2\" (UniqueName: \"kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.074774 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.074743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.074931 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.074914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:15.080434 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.080414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q48v2\" (UniqueName: \"kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2\") pod \"authorino-76877994-qtkqv\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.080519 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.080445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffn99\" (UniqueName: \"kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99\") pod \"authorino-5684498977-ll8n5\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:15.195088 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.194986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:27:15.318101 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.318077 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:27:15.320693 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:27:15.320667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc3e990_dd6c_45d4_9d5a_f6df8d3207b4.slice/crio-c7c374f3557816e22e53a4abdb2e0dfeaca7d20a6ee1d3d20abd71963294f138 WatchSource:0}: Error finding container c7c374f3557816e22e53a4abdb2e0dfeaca7d20a6ee1d3d20abd71963294f138: Status 404 returned error can't find the container with id c7c374f3557816e22e53a4abdb2e0dfeaca7d20a6ee1d3d20abd71963294f138 Jun 09 01:27:15.419151 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.419123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.419281 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.419159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:15.419281 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.419119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5684498977-ll8n5" event={"ID":"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4","Type":"ContainerStarted","Data":"c7c374f3557816e22e53a4abdb2e0dfeaca7d20a6ee1d3d20abd71963294f138"} Jun 09 01:27:15.425434 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.425414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:15.427955 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.427938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:15.577013 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.576928 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q48v2\" (UniqueName: \"kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2\") pod \"6aa04a46-1524-40b2-9c1e-d18576a35c93\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " Jun 09 01:27:15.577013 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.576988 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert\") pod \"6aa04a46-1524-40b2-9c1e-d18576a35c93\" (UID: \"6aa04a46-1524-40b2-9c1e-d18576a35c93\") " Jun 09 01:27:15.577184 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.577052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-956wq\" (UniqueName: \"kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq\") pod \"c01c40be-89a5-47a8-ac12-da67eff2e643\" (UID: \"c01c40be-89a5-47a8-ac12-da67eff2e643\") " Jun 09 01:27:15.579172 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.579143 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2" (OuterVolumeSpecName: "kube-api-access-q48v2") pod "6aa04a46-1524-40b2-9c1e-d18576a35c93" (UID: "6aa04a46-1524-40b2-9c1e-d18576a35c93"). InnerVolumeSpecName "kube-api-access-q48v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:27:15.579282 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.579175 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq" (OuterVolumeSpecName: "kube-api-access-956wq") pod "c01c40be-89a5-47a8-ac12-da67eff2e643" (UID: "c01c40be-89a5-47a8-ac12-da67eff2e643"). InnerVolumeSpecName "kube-api-access-956wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:27:15.579282 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.579177 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6aa04a46-1524-40b2-9c1e-d18576a35c93" (UID: "6aa04a46-1524-40b2-9c1e-d18576a35c93"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:27:15.677696 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.677647 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-956wq\" (UniqueName: \"kubernetes.io/projected/c01c40be-89a5-47a8-ac12-da67eff2e643-kube-api-access-956wq\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:27:15.677696 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.677691 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q48v2\" (UniqueName: \"kubernetes.io/projected/6aa04a46-1524-40b2-9c1e-d18576a35c93-kube-api-access-q48v2\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:27:15.677696 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:15.677705 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aa04a46-1524-40b2-9c1e-d18576a35c93-tls-cert\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:27:16.424484 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.424448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5684498977-ll8n5" event={"ID":"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4","Type":"ContainerStarted","Data":"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71"} Jun 09 01:27:16.424650 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.424564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qtkqv" Jun 09 01:27:16.424787 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.424744 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gn9mt" Jun 09 01:27:16.439445 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.439406 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5684498977-ll8n5" podStartSLOduration=2.047076107 podStartE2EDuration="2.439391503s" totalImagesPullingTime="392.315396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:27:16.438639277 +0000 UTC m=+679.791951602" watchObservedRunningTime="2026-06-09 01:27:16.439391503 +0000 UTC m=+679.792703827" Jun 09 01:27:16.460527 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.460499 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qtkqv"] Jun 09 01:27:16.466343 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.466313 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:27:16.466902 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.466495 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-czjzd" podUID="dc99743e-de83-4ba0-a158-4c5586942307" containerName="authorino" containerID="cri-o://fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be" gracePeriod=30 Jun 09 01:27:16.468006 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.467987 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-qtkqv"] Jun 09 01:27:16.493351 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.493320 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gn9mt"] Jun 09 01:27:16.501140 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.501116 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gn9mt"] Jun 09 01:27:16.698671 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.698650 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:27:16.787282 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.787251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbl92\" (UniqueName: \"kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92\") pod \"dc99743e-de83-4ba0-a158-4c5586942307\" (UID: \"dc99743e-de83-4ba0-a158-4c5586942307\") " Jun 09 01:27:16.789243 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.789217 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92" (OuterVolumeSpecName: "kube-api-access-sbl92") pod "dc99743e-de83-4ba0-a158-4c5586942307" (UID: "dc99743e-de83-4ba0-a158-4c5586942307"). InnerVolumeSpecName "kube-api-access-sbl92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:27:16.888400 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:16.888369 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbl92\" (UniqueName: \"kubernetes.io/projected/dc99743e-de83-4ba0-a158-4c5586942307-kube-api-access-sbl92\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:27:17.097866 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.097834 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa04a46-1524-40b2-9c1e-d18576a35c93" path="/var/lib/kubelet/pods/6aa04a46-1524-40b2-9c1e-d18576a35c93/volumes" Jun 09 01:27:17.098062 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.098051 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c01c40be-89a5-47a8-ac12-da67eff2e643" path="/var/lib/kubelet/pods/c01c40be-89a5-47a8-ac12-da67eff2e643/volumes" Jun 09 01:27:17.429473 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.429379 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc99743e-de83-4ba0-a158-4c5586942307" containerID="fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be" exitCode=0 Jun 09 01:27:17.429473 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.429442 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-czjzd" Jun 09 01:27:17.429666 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.429467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-czjzd" event={"ID":"dc99743e-de83-4ba0-a158-4c5586942307","Type":"ContainerDied","Data":"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be"} Jun 09 01:27:17.429666 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.429512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-czjzd" event={"ID":"dc99743e-de83-4ba0-a158-4c5586942307","Type":"ContainerDied","Data":"8c763fdbc638796c5e88fc748c2d6f600ad245d69aaa8f4c7a3037bf3b4f83be"} Jun 09 01:27:17.429666 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.429532 2576 scope.go:117] "RemoveContainer" containerID="fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be" Jun 09 01:27:17.437596 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.437575 2576 scope.go:117] "RemoveContainer" containerID="fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be" Jun 09 01:27:17.437862 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:27:17.437844 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be\": container with ID starting with fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be not found: ID does not exist" containerID="fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be" Jun 09 01:27:17.437915 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.437871 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be"} err="failed to get container status \"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be\": rpc error: code = NotFound desc = could not find container \"fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be\": container with ID starting with fa1f477f7b9706f6ecf1e86347474e0eb182ae319e11b4fad912fb21af8f15be not found: ID does not exist" Jun 09 01:27:17.443856 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.443833 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:27:17.446967 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:17.446946 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-czjzd"] Jun 09 01:27:19.096436 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:27:19.096395 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc99743e-de83-4ba0-a158-4c5586942307" path="/var/lib/kubelet/pods/dc99743e-de83-4ba0-a158-4c5586942307/volumes" Jun 09 01:28:53.659078 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.659041 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:28:53.659502 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.659317 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc99743e-de83-4ba0-a158-4c5586942307" containerName="authorino" Jun 09 01:28:53.659502 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.659329 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc99743e-de83-4ba0-a158-4c5586942307" containerName="authorino" Jun 09 01:28:53.659502 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.659380 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc99743e-de83-4ba0-a158-4c5586942307" containerName="authorino" Jun 09 01:28:53.662171 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.662154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.665348 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.665324 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 01:28:53.670467 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.670445 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:28:53.783021 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.782990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.783135 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.783036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7s8\" (UniqueName: \"kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.783135 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.783087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.883958 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.883932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.884073 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.883977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7s8\" (UniqueName: \"kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.884073 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.884013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.884671 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.884652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.886382 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.886363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.892286 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.892264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7s8\" (UniqueName: \"kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8\") pod \"authorino-786bdcb9d9-9ngll\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:53.971365 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:53.971293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:28:54.091027 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.091003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:28:54.093255 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:28:54.093228 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca589836_9232_49fe_babe_7231e0a46248.slice/crio-9c54c11b7dd098ed485aa3dc04caa3f3abd3b085e45a7ab4744e8342665ccfff WatchSource:0}: Error finding container 9c54c11b7dd098ed485aa3dc04caa3f3abd3b085e45a7ab4744e8342665ccfff: Status 404 returned error can't find the container with id 9c54c11b7dd098ed485aa3dc04caa3f3abd3b085e45a7ab4744e8342665ccfff Jun 09 01:28:54.094478 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.094459 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:28:54.811503 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.811421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" event={"ID":"ca589836-9232-49fe-babe-7231e0a46248","Type":"ContainerStarted","Data":"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3"} Jun 09 01:28:54.811503 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.811463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" event={"ID":"ca589836-9232-49fe-babe-7231e0a46248","Type":"ContainerStarted","Data":"9c54c11b7dd098ed485aa3dc04caa3f3abd3b085e45a7ab4744e8342665ccfff"} Jun 09 01:28:54.827171 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.827091 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" podStartSLOduration=1.407450761 podStartE2EDuration="1.827072326s" totalImagesPullingTime="419.621565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:28:54.826730083 +0000 UTC m=+778.180042407" watchObservedRunningTime="2026-06-09 01:28:54.827072326 +0000 UTC m=+778.180384651" Jun 09 01:28:54.854171 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.854143 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:28:54.854314 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:54.854299 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5684498977-ll8n5" podUID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" containerName="authorino" containerID="cri-o://491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71" gracePeriod=30 Jun 09 01:28:55.111942 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.111919 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:28:55.294709 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.294676 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert\") pod \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " Jun 09 01:28:55.294888 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.294722 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffn99\" (UniqueName: \"kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99\") pod \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\" (UID: \"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4\") " Jun 09 01:28:55.296692 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.296658 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99" (OuterVolumeSpecName: "kube-api-access-ffn99") pod "5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" (UID: "5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4"). InnerVolumeSpecName "kube-api-access-ffn99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:28:55.304814 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.304784 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" (UID: "5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:28:55.395240 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.395210 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-tls-cert\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:28:55.395240 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.395238 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffn99\" (UniqueName: \"kubernetes.io/projected/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4-kube-api-access-ffn99\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:28:55.815968 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.815879 2576 generic.go:356] "Generic (PLEG): container finished" podID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" containerID="491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71" exitCode=0 Jun 09 01:28:55.815968 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.815930 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5684498977-ll8n5" Jun 09 01:28:55.816362 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.815972 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5684498977-ll8n5" event={"ID":"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4","Type":"ContainerDied","Data":"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71"} Jun 09 01:28:55.816362 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.816014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5684498977-ll8n5" event={"ID":"5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4","Type":"ContainerDied","Data":"c7c374f3557816e22e53a4abdb2e0dfeaca7d20a6ee1d3d20abd71963294f138"} Jun 09 01:28:55.816362 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.816034 2576 scope.go:117] "RemoveContainer" containerID="491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71" Jun 09 01:28:55.824997 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.824981 2576 scope.go:117] "RemoveContainer" containerID="491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71" Jun 09 01:28:55.825253 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:28:55.825234 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71\": container with ID starting with 491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71 not found: ID does not exist" containerID="491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71" Jun 09 01:28:55.825302 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.825261 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71"} err="failed to get container status \"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71\": rpc error: code = NotFound desc = could not find container \"491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71\": container with ID starting with 491afd189a48baf6f191cae2097133e67b3d23866bfd72c3f755546eb0947e71 not found: ID does not exist" Jun 09 01:28:55.836285 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.836263 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:28:55.842040 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:55.842019 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5684498977-ll8n5"] Jun 09 01:28:57.096857 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:28:57.096830 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" path="/var/lib/kubelet/pods/5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4/volumes" Jun 09 01:30:00.139494 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.139454 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:30:00.140077 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.139864 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" containerName="authorino" Jun 09 01:30:00.140077 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.139880 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" containerName="authorino" Jun 09 01:30:00.140077 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.139970 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc3e990-dd6c-45d4-9d5a-f6df8d3207b4" containerName="authorino" Jun 09 01:30:00.142825 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.142803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:30:00.145219 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.145198 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 01:30:00.146512 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.146496 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 01:30:00.146582 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.146515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-vfg2s\"" Jun 09 01:30:00.149452 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.149430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:30:00.262331 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.262296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgd9\" (UniqueName: \"kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9\") pod \"maas-api-key-cleanup-29682810-dh8ws\" (UID: \"978e3693-d298-4de7-8bd7-414ebf769e00\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:30:00.363499 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.363468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgd9\" (UniqueName: \"kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9\") pod \"maas-api-key-cleanup-29682810-dh8ws\" (UID: \"978e3693-d298-4de7-8bd7-414ebf769e00\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:30:00.372081 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.372059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgd9\" (UniqueName: \"kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9\") pod \"maas-api-key-cleanup-29682810-dh8ws\" (UID: \"978e3693-d298-4de7-8bd7-414ebf769e00\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:30:00.454365 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.454304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:30:00.577202 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:00.577180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:30:00.579721 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:30:00.579693 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978e3693_d298_4de7_8bd7_414ebf769e00.slice/crio-932dcc77bbb1420b91e28c12dfe71d1cfb9df3f2006011f27563cf59f5c9a9b1 WatchSource:0}: Error finding container 932dcc77bbb1420b91e28c12dfe71d1cfb9df3f2006011f27563cf59f5c9a9b1: Status 404 returned error can't find the container with id 932dcc77bbb1420b91e28c12dfe71d1cfb9df3f2006011f27563cf59f5c9a9b1 Jun 09 01:30:01.070958 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:01.070923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" event={"ID":"978e3693-d298-4de7-8bd7-414ebf769e00","Type":"ContainerStarted","Data":"932dcc77bbb1420b91e28c12dfe71d1cfb9df3f2006011f27563cf59f5c9a9b1"} Jun 09 01:30:05.088951 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:05.088883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" event={"ID":"978e3693-d298-4de7-8bd7-414ebf769e00","Type":"ContainerStarted","Data":"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64"} Jun 09 01:30:05.103366 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:05.103314 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" podStartSLOduration=0.92488055 podStartE2EDuration="5.103295768s" totalImagesPullingTime="4.178415218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:30:05.103156357 +0000 UTC m=+848.456468682" watchObservedRunningTime="2026-06-09 01:30:05.103295768 +0000 UTC m=+848.456608085" Jun 09 01:30:57.102644 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:57.102574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:30:57.105442 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:30:57.105420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:31:00.012821 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:00.012783 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:31:00.013212 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:00.012990 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" podUID="978e3693-d298-4de7-8bd7-414ebf769e00" containerName="cleanup" containerID="cri-o://b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64" gracePeriod=30 Jun 09 01:31:16.257589 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.257554 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d987c9d6d-qjlzg"] Jun 09 01:31:16.260506 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.260490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.268432 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.268408 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d987c9d6d-qjlzg"] Jun 09 01:31:16.399355 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.399324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zf47\" (UniqueName: \"kubernetes.io/projected/ed929121-4317-4360-94d0-c5d4acb3e763-kube-api-access-8zf47\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.399507 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.399362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed929121-4317-4360-94d0-c5d4acb3e763-oidc-ca\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.399507 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.399381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed929121-4317-4360-94d0-c5d4acb3e763-tls-cert\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.500074 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.500048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zf47\" (UniqueName: \"kubernetes.io/projected/ed929121-4317-4360-94d0-c5d4acb3e763-kube-api-access-8zf47\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.500201 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.500082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed929121-4317-4360-94d0-c5d4acb3e763-oidc-ca\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.500201 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.500104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed929121-4317-4360-94d0-c5d4acb3e763-tls-cert\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.500810 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.500792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed929121-4317-4360-94d0-c5d4acb3e763-oidc-ca\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.502565 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.502545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed929121-4317-4360-94d0-c5d4acb3e763-tls-cert\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.507382 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.507360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zf47\" (UniqueName: \"kubernetes.io/projected/ed929121-4317-4360-94d0-c5d4acb3e763-kube-api-access-8zf47\") pod \"authorino-6d987c9d6d-qjlzg\" (UID: \"ed929121-4317-4360-94d0-c5d4acb3e763\") " pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.569981 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.569914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" Jun 09 01:31:16.704374 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:16.704346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d987c9d6d-qjlzg"] Jun 09 01:31:16.706901 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:31:16.706874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded929121_4317_4360_94d0_c5d4acb3e763.slice/crio-953d026a2f234f297119b73a7b5730dc49f8226cfdc956a78f12762729e2ce68 WatchSource:0}: Error finding container 953d026a2f234f297119b73a7b5730dc49f8226cfdc956a78f12762729e2ce68: Status 404 returned error can't find the container with id 953d026a2f234f297119b73a7b5730dc49f8226cfdc956a78f12762729e2ce68 Jun 09 01:31:17.365446 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.365411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" event={"ID":"ed929121-4317-4360-94d0-c5d4acb3e763","Type":"ContainerStarted","Data":"e10a21f0b7fe0f8e78fb9b7fde399402f2e403ce10341dd6d09cbdddcd399b91"} Jun 09 01:31:17.365446 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.365448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" event={"ID":"ed929121-4317-4360-94d0-c5d4acb3e763","Type":"ContainerStarted","Data":"953d026a2f234f297119b73a7b5730dc49f8226cfdc956a78f12762729e2ce68"} Jun 09 01:31:17.381504 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.381395 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d987c9d6d-qjlzg" podStartSLOduration=0.971235859 podStartE2EDuration="1.381378469s" totalImagesPullingTime="410.14261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:31:17.379677987 +0000 UTC m=+920.732990311" watchObservedRunningTime="2026-06-09 01:31:17.381378469 +0000 UTC m=+920.734690834" Jun 09 01:31:17.410780 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.410735 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:31:17.410959 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.410927 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" podUID="ca589836-9232-49fe-babe-7231e0a46248" containerName="authorino" containerID="cri-o://04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3" gracePeriod=30 Jun 09 01:31:17.645329 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.645304 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:31:17.709866 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.709840 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca\") pod \"ca589836-9232-49fe-babe-7231e0a46248\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " Jun 09 01:31:17.710007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.709901 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert\") pod \"ca589836-9232-49fe-babe-7231e0a46248\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " Jun 09 01:31:17.710007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.709928 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws7s8\" (UniqueName: \"kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8\") pod \"ca589836-9232-49fe-babe-7231e0a46248\" (UID: \"ca589836-9232-49fe-babe-7231e0a46248\") " Jun 09 01:31:17.712172 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.712133 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8" (OuterVolumeSpecName: "kube-api-access-ws7s8") pod "ca589836-9232-49fe-babe-7231e0a46248" (UID: "ca589836-9232-49fe-babe-7231e0a46248"). InnerVolumeSpecName "kube-api-access-ws7s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:31:17.714276 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.714248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "ca589836-9232-49fe-babe-7231e0a46248" (UID: "ca589836-9232-49fe-babe-7231e0a46248"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:31:17.718507 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.718477 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ca589836-9232-49fe-babe-7231e0a46248" (UID: "ca589836-9232-49fe-babe-7231e0a46248"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:31:17.811068 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.811030 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca589836-9232-49fe-babe-7231e0a46248-oidc-ca\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:31:17.811068 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.811064 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca589836-9232-49fe-babe-7231e0a46248-tls-cert\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:31:17.811068 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:17.811074 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7s8\" (UniqueName: \"kubernetes.io/projected/ca589836-9232-49fe-babe-7231e0a46248-kube-api-access-ws7s8\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:31:18.370827 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.370791 2576 generic.go:356] "Generic (PLEG): container finished" podID="ca589836-9232-49fe-babe-7231e0a46248" containerID="04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3" exitCode=0 Jun 09 01:31:18.370827 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.370832 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" Jun 09 01:31:18.371234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.370875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" event={"ID":"ca589836-9232-49fe-babe-7231e0a46248","Type":"ContainerDied","Data":"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3"} Jun 09 01:31:18.371234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.370915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bdcb9d9-9ngll" event={"ID":"ca589836-9232-49fe-babe-7231e0a46248","Type":"ContainerDied","Data":"9c54c11b7dd098ed485aa3dc04caa3f3abd3b085e45a7ab4744e8342665ccfff"} Jun 09 01:31:18.371234 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.370933 2576 scope.go:117] "RemoveContainer" containerID="04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3" Jun 09 01:31:18.383941 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.383924 2576 scope.go:117] "RemoveContainer" containerID="04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3" Jun 09 01:31:18.384181 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:31:18.384161 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3\": container with ID starting with 04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3 not found: ID does not exist" containerID="04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3" Jun 09 01:31:18.384244 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.384187 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3"} err="failed to get container status \"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3\": rpc error: code = NotFound desc = could not find container \"04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3\": container with ID starting with 04c01d5d25d5c3dc2445f776c3262c00f4932b352f0e72c51875bc2aa3fcc7c3 not found: ID does not exist" Jun 09 01:31:18.394664 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.394644 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:31:18.400106 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:18.400087 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-786bdcb9d9-9ngll"] Jun 09 01:31:19.096154 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:19.096112 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca589836-9232-49fe-babe-7231e0a46248" path="/var/lib/kubelet/pods/ca589836-9232-49fe-babe-7231e0a46248/volumes" Jun 09 01:31:30.196372 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.196344 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:31:30.312007 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.311920 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwgd9\" (UniqueName: \"kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9\") pod \"978e3693-d298-4de7-8bd7-414ebf769e00\" (UID: \"978e3693-d298-4de7-8bd7-414ebf769e00\") " Jun 09 01:31:30.313993 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.313957 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9" (OuterVolumeSpecName: "kube-api-access-hwgd9") pod "978e3693-d298-4de7-8bd7-414ebf769e00" (UID: "978e3693-d298-4de7-8bd7-414ebf769e00"). InnerVolumeSpecName "kube-api-access-hwgd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:31:30.413421 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.413393 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwgd9\" (UniqueName: \"kubernetes.io/projected/978e3693-d298-4de7-8bd7-414ebf769e00-kube-api-access-hwgd9\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:31:30.418300 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.418273 2576 generic.go:356] "Generic (PLEG): container finished" podID="978e3693-d298-4de7-8bd7-414ebf769e00" containerID="b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64" exitCode=137 Jun 09 01:31:30.418429 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.418314 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" Jun 09 01:31:30.418429 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.418317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" event={"ID":"978e3693-d298-4de7-8bd7-414ebf769e00","Type":"ContainerDied","Data":"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64"} Jun 09 01:31:30.418429 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.418369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws" event={"ID":"978e3693-d298-4de7-8bd7-414ebf769e00","Type":"ContainerDied","Data":"932dcc77bbb1420b91e28c12dfe71d1cfb9df3f2006011f27563cf59f5c9a9b1"} Jun 09 01:31:30.418429 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.418403 2576 scope.go:117] "RemoveContainer" containerID="b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64" Jun 09 01:31:30.426298 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.426281 2576 scope.go:117] "RemoveContainer" containerID="b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64" Jun 09 01:31:30.426548 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:31:30.426528 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64\": container with ID starting with b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64 not found: ID does not exist" containerID="b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64" Jun 09 01:31:30.426599 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.426554 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64"} err="failed to get container status \"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64\": rpc error: code = NotFound desc = could not find container \"b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64\": container with ID starting with b32ce0b12e5a087b1ef5688cd8e0f91504f9aaf6d4598921d025a88459c0fa64 not found: ID does not exist" Jun 09 01:31:30.438175 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.438150 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:31:30.442266 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:30.442245 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682810-dh8ws"] Jun 09 01:31:31.099928 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:31:31.098251 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978e3693-d298-4de7-8bd7-414ebf769e00" path="/var/lib/kubelet/pods/978e3693-d298-4de7-8bd7-414ebf769e00/volumes" Jun 09 01:32:48.806695 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.806659 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d888fff7f-kqwfc"] Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.806961 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca589836-9232-49fe-babe-7231e0a46248" containerName="authorino" Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.806974 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca589836-9232-49fe-babe-7231e0a46248" containerName="authorino" Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.806985 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978e3693-d298-4de7-8bd7-414ebf769e00" containerName="cleanup" Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.806990 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="978e3693-d298-4de7-8bd7-414ebf769e00" containerName="cleanup" Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.807032 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca589836-9232-49fe-babe-7231e0a46248" containerName="authorino" Jun 09 01:32:48.807166 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.807038 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="978e3693-d298-4de7-8bd7-414ebf769e00" containerName="cleanup" Jun 09 01:32:48.809699 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.809683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:48.812225 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.812197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 01:32:48.813398 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.813378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fhzw5\"" Jun 09 01:32:48.813529 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.813493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 01:32:48.818560 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.818540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d888fff7f-kqwfc"] Jun 09 01:32:48.917854 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.917818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-webhook-cert\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:48.918023 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:48.917869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8b5k\" (UniqueName: \"kubernetes.io/projected/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-kube-api-access-m8b5k\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.018976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.018929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-webhook-cert\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.018976 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.018982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8b5k\" (UniqueName: \"kubernetes.io/projected/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-kube-api-access-m8b5k\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.021409 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.021389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-webhook-cert\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.028841 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.028817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8b5k\" (UniqueName: \"kubernetes.io/projected/3ea537f5-25db-41bc-a7c5-b3b3eabbb17c-kube-api-access-m8b5k\") pod \"maas-controller-5d888fff7f-kqwfc\" (UID: \"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c\") " pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.119396 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.119369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:49.242085 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.242066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d888fff7f-kqwfc"] Jun 09 01:32:49.244884 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:32:49.244854 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea537f5_25db_41bc_a7c5_b3b3eabbb17c.slice/crio-65a34d9aaa060881306ca7311a6972e5af6064756f4209298fe8979fdfa7c354 WatchSource:0}: Error finding container 65a34d9aaa060881306ca7311a6972e5af6064756f4209298fe8979fdfa7c354: Status 404 returned error can't find the container with id 65a34d9aaa060881306ca7311a6972e5af6064756f4209298fe8979fdfa7c354 Jun 09 01:32:49.740777 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:49.740727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" event={"ID":"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c","Type":"ContainerStarted","Data":"65a34d9aaa060881306ca7311a6972e5af6064756f4209298fe8979fdfa7c354"} Jun 09 01:32:51.750589 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:51.750552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" event={"ID":"3ea537f5-25db-41bc-a7c5-b3b3eabbb17c","Type":"ContainerStarted","Data":"5337d157b062119b20b943da953061d779c280291b9492acd9e1655ef58f7872"} Jun 09 01:32:51.750971 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:51.750615 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:32:51.767991 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:32:51.767944 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" podStartSLOduration=1.440706635 podStartE2EDuration="3.767929771s" totalImagesPullingTime="2.327223136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:32:51.765502015 +0000 UTC m=+1015.118814360" watchObservedRunningTime="2026-06-09 01:32:51.767929771 +0000 UTC m=+1015.121242098" Jun 09 01:33:02.760782 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:33:02.760728 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d888fff7f-kqwfc" Jun 09 01:35:57.125128 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:35:57.125099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:35:57.127630 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:35:57.127607 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:40:57.151496 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:40:57.151467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:40:57.154546 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:40:57.154526 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:45:00.132888 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.132853 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:45:00.135921 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.135906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:45:00.138606 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.138579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-vfg2s\"" Jun 09 01:45:00.138606 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.138595 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 01:45:00.138797 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.138625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 01:45:00.143299 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.143273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:45:00.278150 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.278122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbws\" (UniqueName: \"kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws\") pod \"maas-api-key-cleanup-29682825-t7pfc\" (UID: \"9bc3387c-20ba-4105-a4e1-b24a2012bbf6\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:45:00.379477 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.379441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbws\" (UniqueName: \"kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws\") pod \"maas-api-key-cleanup-29682825-t7pfc\" (UID: \"9bc3387c-20ba-4105-a4e1-b24a2012bbf6\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:45:00.389399 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.389334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbws\" (UniqueName: \"kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws\") pod \"maas-api-key-cleanup-29682825-t7pfc\" (UID: \"9bc3387c-20ba-4105-a4e1-b24a2012bbf6\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:45:00.446769 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.446729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:45:00.571000 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:00.570932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:45:00.574544 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:45:00.574515 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc3387c_20ba_4105_a4e1_b24a2012bbf6.slice/crio-60dde9cb21d9dc6149917af893f2c09cde35e0ccaf01817f4c46d40affc0971f WatchSource:0}: Error finding container 60dde9cb21d9dc6149917af893f2c09cde35e0ccaf01817f4c46d40affc0971f: Status 404 returned error can't find the container with id 60dde9cb21d9dc6149917af893f2c09cde35e0ccaf01817f4c46d40affc0971f Jun 09 01:45:01.568794 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:01.568747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" event={"ID":"9bc3387c-20ba-4105-a4e1-b24a2012bbf6","Type":"ContainerStarted","Data":"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8"} Jun 09 01:45:01.569145 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:01.568813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" event={"ID":"9bc3387c-20ba-4105-a4e1-b24a2012bbf6","Type":"ContainerStarted","Data":"60dde9cb21d9dc6149917af893f2c09cde35e0ccaf01817f4c46d40affc0971f"} Jun 09 01:45:01.586311 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:01.586264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" podStartSLOduration=1.586246662 podStartE2EDuration="1.586246662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:45:01.58501334 +0000 UTC m=+1744.938325667" watchObservedRunningTime="2026-06-09 01:45:01.586246662 +0000 UTC m=+1744.939558986" Jun 09 01:45:57.173095 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:57.173070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:45:57.176599 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:45:57.176580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:46:00.011228 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:00.011194 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:46:00.011644 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:00.011372 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" podUID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" containerName="cleanup" containerID="cri-o://f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8" gracePeriod=30 Jun 09 01:46:30.196812 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.196782 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:46:30.261718 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.261680 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwbws\" (UniqueName: \"kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws\") pod \"9bc3387c-20ba-4105-a4e1-b24a2012bbf6\" (UID: \"9bc3387c-20ba-4105-a4e1-b24a2012bbf6\") " Jun 09 01:46:30.263796 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.263768 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws" (OuterVolumeSpecName: "kube-api-access-kwbws") pod "9bc3387c-20ba-4105-a4e1-b24a2012bbf6" (UID: "9bc3387c-20ba-4105-a4e1-b24a2012bbf6"). InnerVolumeSpecName "kube-api-access-kwbws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:46:30.362145 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.362113 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwbws\" (UniqueName: \"kubernetes.io/projected/9bc3387c-20ba-4105-a4e1-b24a2012bbf6-kube-api-access-kwbws\") on node \"ip-10-0-129-196.ec2.internal\" DevicePath \"\"" Jun 09 01:46:30.927542 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.927506 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" containerID="f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8" exitCode=137 Jun 09 01:46:30.927741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.927554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" event={"ID":"9bc3387c-20ba-4105-a4e1-b24a2012bbf6","Type":"ContainerDied","Data":"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8"} Jun 09 01:46:30.927741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.927573 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" Jun 09 01:46:30.927741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.927634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc" event={"ID":"9bc3387c-20ba-4105-a4e1-b24a2012bbf6","Type":"ContainerDied","Data":"60dde9cb21d9dc6149917af893f2c09cde35e0ccaf01817f4c46d40affc0971f"} Jun 09 01:46:30.927741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.927663 2576 scope.go:117] "RemoveContainer" containerID="f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8" Jun 09 01:46:30.935822 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.935804 2576 scope.go:117] "RemoveContainer" containerID="f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8" Jun 09 01:46:30.936084 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:46:30.936050 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8\": container with ID starting with f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8 not found: ID does not exist" containerID="f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8" Jun 09 01:46:30.936137 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.936083 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8"} err="failed to get container status \"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8\": rpc error: code = NotFound desc = could not find container \"f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8\": container with ID starting with f30cec8935adb913c9657e4b4a432164a9cd6e7c456d902e596f0c74de8926f8 not found: ID does not exist" Jun 09 01:46:30.947398 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.947371 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:46:30.951173 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:30.951153 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682825-t7pfc"] Jun 09 01:46:31.096322 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:46:31.096291 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" path="/var/lib/kubelet/pods/9bc3387c-20ba-4105-a4e1-b24a2012bbf6/volumes" Jun 09 01:50:57.195481 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:50:57.195454 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:50:57.199232 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:50:57.199208 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbcbf_0e999ebe-4200-48d6-a68e-d8d55a859c39/ovn-acl-logging/0.log" Jun 09 01:53:45.672741 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.672666 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5"] Jun 09 01:53:45.673132 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.672987 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" containerName="cleanup" Jun 09 01:53:45.673132 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.672998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" containerName="cleanup" Jun 09 01:53:45.673132 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.673065 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc3387c-20ba-4105-a4e1-b24a2012bbf6" containerName="cleanup" Jun 09 01:53:45.675852 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.675835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.679995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.679954 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 01:53:45.679995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.679960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 01:53:45.680215 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.679960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-vfg2s\"" Jun 09 01:53:45.680215 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.680044 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 01:53:45.685801 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.685776 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5"] Jun 09 01:53:45.874345 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.874311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vt9x\" (UniqueName: \"kubernetes.io/projected/d70c2857-0bef-4e80-ab66-09772f9edda4-kube-api-access-4vt9x\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.874513 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.874371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70c2857-0bef-4e80-ab66-09772f9edda4-maas-api-tls\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.975820 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.975706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vt9x\" (UniqueName: \"kubernetes.io/projected/d70c2857-0bef-4e80-ab66-09772f9edda4-kube-api-access-4vt9x\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.975820 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.975798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70c2857-0bef-4e80-ab66-09772f9edda4-maas-api-tls\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.978346 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.978319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70c2857-0bef-4e80-ab66-09772f9edda4-maas-api-tls\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.984211 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.984189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vt9x\" (UniqueName: \"kubernetes.io/projected/d70c2857-0bef-4e80-ab66-09772f9edda4-kube-api-access-4vt9x\") pod \"maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5\" (UID: \"d70c2857-0bef-4e80-ab66-09772f9edda4\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:45.986933 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:45.986916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:46.132082 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:46.132050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5"] Jun 09 01:53:46.135556 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:53:46.135526 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70c2857_0bef_4e80_ab66_09772f9edda4.slice/crio-7e49740b9a6d1060e8d3d861455f7fc61fd9cb353ef9b70514c27926ae917418 WatchSource:0}: Error finding container 7e49740b9a6d1060e8d3d861455f7fc61fd9cb353ef9b70514c27926ae917418: Status 404 returned error can't find the container with id 7e49740b9a6d1060e8d3d861455f7fc61fd9cb353ef9b70514c27926ae917418 Jun 09 01:53:46.136928 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:46.136910 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:53:46.608474 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:46.608438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerStarted","Data":"7e49740b9a6d1060e8d3d861455f7fc61fd9cb353ef9b70514c27926ae917418"} Jun 09 01:53:48.617955 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:48.617919 2576 generic.go:356] "Generic (PLEG): container finished" podID="d70c2857-0bef-4e80-ab66-09772f9edda4" containerID="364914661a839c788599f2966abd7aa1adcc95ff80444d4208df48e3de55f64c" exitCode=1 Jun 09 01:53:48.618384 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:48.618011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerDied","Data":"364914661a839c788599f2966abd7aa1adcc95ff80444d4208df48e3de55f64c"} Jun 09 01:53:48.618384 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:48.618150 2576 scope.go:117] "RemoveContainer" containerID="364914661a839c788599f2966abd7aa1adcc95ff80444d4208df48e3de55f64c" Jun 09 01:53:49.624324 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:49.624296 2576 generic.go:356] "Generic (PLEG): container finished" podID="d70c2857-0bef-4e80-ab66-09772f9edda4" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" exitCode=1 Jun 09 01:53:49.624731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:49.624384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerDied","Data":"82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024"} Jun 09 01:53:49.624731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:49.624436 2576 scope.go:117] "RemoveContainer" containerID="364914661a839c788599f2966abd7aa1adcc95ff80444d4208df48e3de55f64c" Jun 09 01:53:49.624731 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:49.624648 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:53:49.624894 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:53:49.624858 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:53:50.630292 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:50.630263 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:53:50.630664 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:53:50.630427 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:53:50.987254 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:50.987172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:51.633686 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:51.633662 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:53:51.634059 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:53:51.633841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:53:55.987887 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:55.987852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:53:55.988256 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:55.988237 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:53:55.988417 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:53:55.988397 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:53:58.190492 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.190460 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9"] Jun 09 01:53:58.193463 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.193444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.204049 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.204022 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9"] Jun 09 01:53:58.261232 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.261171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxcmc\" (UniqueName: \"kubernetes.io/projected/0b125431-0d4a-4350-b73e-aa474dc00983-kube-api-access-qxcmc\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.261232 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.261216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b125431-0d4a-4350-b73e-aa474dc00983-maas-api-tls\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.361561 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.361528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxcmc\" (UniqueName: \"kubernetes.io/projected/0b125431-0d4a-4350-b73e-aa474dc00983-kube-api-access-qxcmc\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.361724 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.361579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b125431-0d4a-4350-b73e-aa474dc00983-maas-api-tls\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.364074 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.364052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b125431-0d4a-4350-b73e-aa474dc00983-maas-api-tls\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.370126 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.370101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxcmc\" (UniqueName: \"kubernetes.io/projected/0b125431-0d4a-4350-b73e-aa474dc00983-kube-api-access-qxcmc\") pod \"maas-api-e2e-ait-5929b614-6555cffd77-sgnw9\" (UID: \"0b125431-0d4a-4350-b73e-aa474dc00983\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.506332 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.506295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:53:58.638040 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.638007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9"] Jun 09 01:53:58.641752 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:53:58.641725 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b125431_0d4a_4350_b73e_aa474dc00983.slice/crio-e95e120a236b8660f39c8c841cfe3b2351b887988132ed834f9547621348f51d WatchSource:0}: Error finding container e95e120a236b8660f39c8c841cfe3b2351b887988132ed834f9547621348f51d: Status 404 returned error can't find the container with id e95e120a236b8660f39c8c841cfe3b2351b887988132ed834f9547621348f51d Jun 09 01:53:58.662027 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:58.662000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" event={"ID":"0b125431-0d4a-4350-b73e-aa474dc00983","Type":"ContainerStarted","Data":"e95e120a236b8660f39c8c841cfe3b2351b887988132ed834f9547621348f51d"} Jun 09 01:53:59.667598 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:59.667567 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b125431-0d4a-4350-b73e-aa474dc00983" containerID="da6c737442c761884f22d625115072908cbe49f591a929ef31ca7cfb58b8c1b7" exitCode=1 Jun 09 01:53:59.668015 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:59.667613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" event={"ID":"0b125431-0d4a-4350-b73e-aa474dc00983","Type":"ContainerDied","Data":"da6c737442c761884f22d625115072908cbe49f591a929ef31ca7cfb58b8c1b7"} Jun 09 01:53:59.668015 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:53:59.667878 2576 scope.go:117] "RemoveContainer" containerID="da6c737442c761884f22d625115072908cbe49f591a929ef31ca7cfb58b8c1b7" Jun 09 01:54:00.673026 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:00.672991 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b125431-0d4a-4350-b73e-aa474dc00983" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" exitCode=1 Jun 09 01:54:00.673470 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:00.673050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" event={"ID":"0b125431-0d4a-4350-b73e-aa474dc00983","Type":"ContainerDied","Data":"e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d"} Jun 09 01:54:00.673470 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:00.673108 2576 scope.go:117] "RemoveContainer" containerID="da6c737442c761884f22d625115072908cbe49f591a929ef31ca7cfb58b8c1b7" Jun 09 01:54:00.673470 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:00.673274 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:00.673578 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:00.673477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:01.678879 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:01.678849 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:01.679210 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:01.679015 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:03.506877 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:03.506839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:03.507241 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:03.507197 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:03.507370 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:03.507350 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:08.507368 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:08.507320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:08.507749 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:08.507683 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:08.507893 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:08.507873 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:09.097165 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:09.097135 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:54:09.715523 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:09.715491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerStarted","Data":"e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9"} Jun 09 01:54:09.715946 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:09.715699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:54:09.734736 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:09.734693 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podStartSLOduration=22.328995781 podStartE2EDuration="24.734680247s" totalImagesPullingTime="2.405684466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:53:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:54:09.733692515 +0000 UTC m=+2293.087004841" watchObservedRunningTime="2026-06-09 01:54:09.734680247 +0000 UTC m=+2293.087992570" Jun 09 01:54:10.721706 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:10.721667 2576 generic.go:356] "Generic (PLEG): container finished" podID="d70c2857-0bef-4e80-ab66-09772f9edda4" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" exitCode=1 Jun 09 01:54:10.722098 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:10.721746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerDied","Data":"e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9"} Jun 09 01:54:10.722098 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:10.721850 2576 scope.go:117] "RemoveContainer" containerID="82bd382b1124211fe7f6abd4e693181e7320cda9b11a703f96e6ca3f8c83d024" Jun 09 01:54:10.722098 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:10.722063 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:10.722291 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:10.722271 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:11.727679 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:11.727655 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:11.728057 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:11.727878 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:15.988090 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:15.988050 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:54:15.988490 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:15.988399 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:15.988575 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:15.988554 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:17.735094 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:17.735064 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d987c9d6d-qjlzg_ed929121-4317-4360-94d0-c5d4acb3e763/authorino/0.log" Jun 09 01:54:22.092069 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.092039 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:22.659203 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.659170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d888fff7f-kqwfc_3ea537f5-25db-41bc-a7c5-b3b3eabbb17c/manager/0.log" Jun 09 01:54:22.771545 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.771515 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b125431-0d4a-4350-b73e-aa474dc00983" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" exitCode=1 Jun 09 01:54:22.771716 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.771550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" event={"ID":"0b125431-0d4a-4350-b73e-aa474dc00983","Type":"ContainerDied","Data":"c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4"} Jun 09 01:54:22.771716 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.771595 2576 scope.go:117] "RemoveContainer" containerID="e1324dc083031fd02b10e72d35ad5e6fea84cc38af04fec075d09e52e8c9935d" Jun 09 01:54:22.771954 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:22.771936 2576 scope.go:117] "RemoveContainer" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" Jun 09 01:54:22.772170 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:22.772149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:23.114075 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:23.114049 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-p7jp9_16056cec-60bf-46ae-a79f-2dabe0895c23/copy-manifests/0.log" Jun 09 01:54:23.120488 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:23.120468 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-p7jp9_16056cec-60bf-46ae-a79f-2dabe0895c23/manager/0.log" Jun 09 01:54:23.507470 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:23.507382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:23.777617 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:23.777532 2576 scope.go:117] "RemoveContainer" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" Jun 09 01:54:23.777752 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:23.777683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:24.515485 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:24.515456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d987c9d6d-qjlzg_ed929121-4317-4360-94d0-c5d4acb3e763/authorino/0.log" Jun 09 01:54:24.742428 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:24.742398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9hcm_7e2b8049-b6eb-4961-a26a-45d88a339cf4/manager/0.log" Jun 09 01:54:24.848983 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:24.848952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qxxdc_5d4647af-a6ad-46c9-a384-85afa19be4be/kuadrant-console-plugin/0.log" Jun 09 01:54:26.017042 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:26.017014 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c846984dd-mscx5_a9e6a719-71bb-4b65-9963-7050f9658dbb/kube-auth-proxy/0.log" Jun 09 01:54:28.506906 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:28.506872 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:28.507278 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:28.507198 2576 scope.go:117] "RemoveContainer" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" Jun 09 01:54:28.507373 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:28.507354 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:29.091792 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:29.091744 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:29.091973 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:29.091952 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:31.318526 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.318492 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4cwjw/must-gather-9xzd7"] Jun 09 01:54:31.321612 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.321590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.324420 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.324400 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4cwjw\"/\"default-dockercfg-5b7d7\"" Jun 09 01:54:31.324694 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.324678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwjw\"/\"openshift-service-ca.crt\"" Jun 09 01:54:31.325706 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.325689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwjw\"/\"kube-root-ca.crt\"" Jun 09 01:54:31.331967 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.331947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/must-gather-9xzd7"] Jun 09 01:54:31.399356 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.399327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13ce22b3-2be2-47dc-aac2-55e85aa8d333-must-gather-output\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.399485 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.399368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ltz\" (UniqueName: \"kubernetes.io/projected/13ce22b3-2be2-47dc-aac2-55e85aa8d333-kube-api-access-v6ltz\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.500846 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.500804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13ce22b3-2be2-47dc-aac2-55e85aa8d333-must-gather-output\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.500960 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.500857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ltz\" (UniqueName: \"kubernetes.io/projected/13ce22b3-2be2-47dc-aac2-55e85aa8d333-kube-api-access-v6ltz\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.501145 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.501127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13ce22b3-2be2-47dc-aac2-55e85aa8d333-must-gather-output\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.508942 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.508919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ltz\" (UniqueName: \"kubernetes.io/projected/13ce22b3-2be2-47dc-aac2-55e85aa8d333-kube-api-access-v6ltz\") pod \"must-gather-9xzd7\" (UID: \"13ce22b3-2be2-47dc-aac2-55e85aa8d333\") " pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.630979 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.630947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" Jun 09 01:54:31.752564 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.752534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/must-gather-9xzd7"] Jun 09 01:54:31.754513 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:54:31.754476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13ce22b3_2be2_47dc_aac2_55e85aa8d333.slice/crio-a8bbb259f7451f0f043599964bd98c2fd37cb08ea09a37584a19be3667902c7b WatchSource:0}: Error finding container a8bbb259f7451f0f043599964bd98c2fd37cb08ea09a37584a19be3667902c7b: Status 404 returned error can't find the container with id a8bbb259f7451f0f043599964bd98c2fd37cb08ea09a37584a19be3667902c7b Jun 09 01:54:31.810212 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:31.810183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" event={"ID":"13ce22b3-2be2-47dc-aac2-55e85aa8d333","Type":"ContainerStarted","Data":"a8bbb259f7451f0f043599964bd98c2fd37cb08ea09a37584a19be3667902c7b"} Jun 09 01:54:32.815929 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:32.815886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" event={"ID":"13ce22b3-2be2-47dc-aac2-55e85aa8d333","Type":"ContainerStarted","Data":"2262eccf6d62dded61cc73affe0892b40d8f1d7a2f5571a909f21de714fadfae"} Jun 09 01:54:33.822355 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:33.822315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" event={"ID":"13ce22b3-2be2-47dc-aac2-55e85aa8d333","Type":"ContainerStarted","Data":"4374ecff8bf1d5b725ae7cdafd7e4db9b2924aa948cefe02201cb2514aae69a3"} Jun 09 01:54:33.840972 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:33.840911 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4cwjw/must-gather-9xzd7" podStartSLOduration=1.902002037 podStartE2EDuration="2.840888923s" totalImagesPullingTime="938.886886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:54:33.838728959 +0000 UTC m=+2317.192041308" watchObservedRunningTime="2026-06-09 01:54:33.840888923 +0000 UTC m=+2317.194201249" Jun 09 01:54:34.537352 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:34.537324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2dqj_aa7e8f4c-f0fa-4aaf-9e22-b4c95228b7ab/global-pull-secret-syncer/0.log" Jun 09 01:54:34.691338 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:34.691312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7l5q6_7f1cf71f-8c56-4267-8075-1942388c153c/konnectivity-agent/0.log" Jun 09 01:54:34.748729 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:34.748677 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-196.ec2.internal_6d5aa0b4a4d5291d38de39444ef485cd/haproxy/0.log" Jun 09 01:54:39.036727 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:39.036697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d987c9d6d-qjlzg_ed929121-4317-4360-94d0-c5d4acb3e763/authorino/0.log" Jun 09 01:54:39.101554 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:39.101521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9hcm_7e2b8049-b6eb-4961-a26a-45d88a339cf4/manager/0.log" Jun 09 01:54:39.128895 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:39.128866 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qxxdc_5d4647af-a6ad-46c9-a384-85afa19be4be/kuadrant-console-plugin/0.log" Jun 09 01:54:40.091923 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:40.091887 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:40.886844 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:40.886801 2576 generic.go:356] "Generic (PLEG): container finished" podID="d70c2857-0bef-4e80-ab66-09772f9edda4" containerID="93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e" exitCode=1 Jun 09 01:54:40.887073 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:40.886936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" event={"ID":"d70c2857-0bef-4e80-ab66-09772f9edda4","Type":"ContainerDied","Data":"93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e"} Jun 09 01:54:40.887073 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:40.886993 2576 scope.go:117] "RemoveContainer" containerID="e99518e3b4c6cd299ba22691ea36395a83c72da7c7c78a41338770bc26ffc7e9" Jun 09 01:54:40.887439 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:40.887417 2576 scope.go:117] "RemoveContainer" containerID="93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e" Jun 09 01:54:40.887657 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:40.887632 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:41.760418 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:41.760386 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfn7w_0b405716-04dd-4c5f-9ed2-54631a55ab26/node-exporter/0.log" Jun 09 01:54:41.784180 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:41.784151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfn7w_0b405716-04dd-4c5f-9ed2-54631a55ab26/kube-rbac-proxy/0.log" Jun 09 01:54:41.804519 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:41.804482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfn7w_0b405716-04dd-4c5f-9ed2-54631a55ab26/init-textfile/0.log" Jun 09 01:54:44.092205 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.092166 2576 scope.go:117] "RemoveContainer" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" Jun 09 01:54:44.716485 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.716378 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:54:44.716996 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.716979 2576 scope.go:117] "RemoveContainer" containerID="93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e" Jun 09 01:54:44.717223 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:44.717200 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:44.916515 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.916471 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b125431-0d4a-4350-b73e-aa474dc00983" containerID="83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903" exitCode=1 Jun 09 01:54:44.916698 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.916618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" event={"ID":"0b125431-0d4a-4350-b73e-aa474dc00983","Type":"ContainerDied","Data":"83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903"} Jun 09 01:54:44.916698 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.916683 2576 scope.go:117] "RemoveContainer" containerID="c504cfea5ba4960cc70a9774f0d05d7435de2dc3f6d747df605d9819aec99fb4" Jun 09 01:54:44.917128 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:44.917106 2576 scope.go:117] "RemoveContainer" containerID="83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903" Jun 09 01:54:44.917356 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:44.917329 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:45.987615 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:45.987580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" Jun 09 01:54:45.988152 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:45.988115 2576 scope.go:117] "RemoveContainer" containerID="93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e" Jun 09 01:54:45.988339 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:45.988317 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:46.871941 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.871897 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx"] Jun 09 01:54:46.877788 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.877748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:46.883540 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.883503 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx"] Jun 09 01:54:46.959296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.959022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-proc\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:46.959296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.959084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-sys\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:46.959296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.959114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-lib-modules\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:46.959296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.959152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-podres\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:46.959296 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:46.959199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkn7g\" (UniqueName: \"kubernetes.io/projected/16edf1e4-21ac-40aa-998d-a1d9a6f65211-kube-api-access-zkn7g\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.059963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-proc\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-sys\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-lib-modules\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-podres\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkn7g\" (UniqueName: \"kubernetes.io/projected/16edf1e4-21ac-40aa-998d-a1d9a6f65211-kube-api-access-zkn7g\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-proc\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-sys\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.060717 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-podres\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.061544 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.060727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16edf1e4-21ac-40aa-998d-a1d9a6f65211-lib-modules\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.069252 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.069222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkn7g\" (UniqueName: \"kubernetes.io/projected/16edf1e4-21ac-40aa-998d-a1d9a6f65211-kube-api-access-zkn7g\") pod \"perf-node-gather-daemonset-md2gx\" (UID: \"16edf1e4-21ac-40aa-998d-a1d9a6f65211\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.194423 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.194343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.367851 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.367749 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx"] Jun 09 01:54:47.370877 ip-10-0-129-196 kubenswrapper[2576]: W0609 01:54:47.370839 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16edf1e4_21ac_40aa_998d_a1d9a6f65211.slice/crio-7727f8353f34bfa4f8679041d9c2ea7c4274ccfc5b7fc6931ebdd337357474e8 WatchSource:0}: Error finding container 7727f8353f34bfa4f8679041d9c2ea7c4274ccfc5b7fc6931ebdd337357474e8: Status 404 returned error can't find the container with id 7727f8353f34bfa4f8679041d9c2ea7c4274ccfc5b7fc6931ebdd337357474e8 Jun 09 01:54:47.484001 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.483972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6js2_50d0cea5-f5be-4c7d-8d25-294bac0dcde6/dns/0.log" Jun 09 01:54:47.502184 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.502151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6js2_50d0cea5-f5be-4c7d-8d25-294bac0dcde6/kube-rbac-proxy/0.log" Jun 09 01:54:47.571479 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.571452 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bzlf9_8a1be551-82d0-4400-bae3-7d50b6c42a2d/dns-node-resolver/0.log" Jun 09 01:54:47.937747 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.937711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" event={"ID":"16edf1e4-21ac-40aa-998d-a1d9a6f65211","Type":"ContainerStarted","Data":"ee69599315ae9d2e95000f8c0df7734beb399d5d3b37c772f5a9fbc243fecd40"} Jun 09 01:54:47.937943 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.937810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" event={"ID":"16edf1e4-21ac-40aa-998d-a1d9a6f65211","Type":"ContainerStarted","Data":"7727f8353f34bfa4f8679041d9c2ea7c4274ccfc5b7fc6931ebdd337357474e8"} Jun 09 01:54:47.937943 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.937851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:47.953342 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:47.953282 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" podStartSLOduration=1.953264525 podStartE2EDuration="1.953264525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:54:47.951987126 +0000 UTC m=+2331.305299447" watchObservedRunningTime="2026-06-09 01:54:47.953264525 +0000 UTC m=+2331.306576850" Jun 09 01:54:48.205995 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:48.205924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-998pt_a2f47376-5df3-4985-b0c6-c990a3c55be7/node-ca/0.log" Jun 09 01:54:48.507386 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:48.507302 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:48.507386 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:48.507375 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" Jun 09 01:54:48.507704 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:48.507686 2576 scope.go:117] "RemoveContainer" containerID="83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903" Jun 09 01:54:48.507948 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:48.507918 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:48.944622 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:48.944595 2576 scope.go:117] "RemoveContainer" containerID="83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903" Jun 09 01:54:48.945074 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:48.945047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:49.276950 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:49.276875 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c846984dd-mscx5_a9e6a719-71bb-4b65-9963-7050f9658dbb/kube-auth-proxy/0.log" Jun 09 01:54:49.964200 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:49.964165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v77p4_bab2fc06-2933-4787-8afb-f17c0d01df76/serve-healthcheck-canary/0.log" Jun 09 01:54:50.574410 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:50.574378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm69f_e249f093-5f45-4184-ba31-6f60e3d11049/kube-rbac-proxy/0.log" Jun 09 01:54:50.592866 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:50.592837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm69f_e249f093-5f45-4184-ba31-6f60e3d11049/exporter/0.log" Jun 09 01:54:50.612675 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:50.612651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm69f_e249f093-5f45-4184-ba31-6f60e3d11049/extractor/0.log" Jun 09 01:54:53.089735 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:53.089697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d888fff7f-kqwfc_3ea537f5-25db-41bc-a7c5-b3b3eabbb17c/manager/0.log" Jun 09 01:54:53.250828 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:53.250798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-p7jp9_16056cec-60bf-46ae-a79f-2dabe0895c23/manager/0.log" Jun 09 01:54:53.270629 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:53.270600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-p7jp9_16056cec-60bf-46ae-a79f-2dabe0895c23/copy-manifests/0.log" Jun 09 01:54:53.957834 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:53.957802 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-md2gx" Jun 09 01:54:54.780355 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:54.780327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-586b6bddf9-bh8dq_9bc65bfd-b49c-4366-9d2d-bfa2208457df/manager/0.log" Jun 09 01:54:57.099817 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:57.099787 2576 scope.go:117] "RemoveContainer" containerID="93bbdaeaf5cd4287fb420a8a5ba5d198a7972edc999b6d63c4881f74bb0b915e" Jun 09 01:54:57.100162 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:57.100026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5_redhat-ai-gateway-infra(d70c2857-0bef-4e80-ab66-09772f9edda4)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-d9890fd0-6998d44f57-r8jv5" podUID="d70c2857-0bef-4e80-ab66-09772f9edda4" Jun 09 01:54:59.100167 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:59.100130 2576 scope.go:117] "RemoveContainer" containerID="83746c4082eb7eefbf3dbb797791ef52a055408f9b764b43ee7c2c275cb48903" Jun 09 01:54:59.100605 ip-10-0-129-196 kubenswrapper[2576]: E0609 01:54:59.100344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5929b614-6555cffd77-sgnw9_redhat-ai-gateway-infra(0b125431-0d4a-4350-b73e-aa474dc00983)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5929b614-6555cffd77-sgnw9" podUID="0b125431-0d4a-4350-b73e-aa474dc00983" Jun 09 01:54:59.885213 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:54:59.885185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c846984dd-mscx5_a9e6a719-71bb-4b65-9963-7050f9658dbb/kube-auth-proxy/0.log" Jun 09 01:55:01.175904 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:01.175874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c846984dd-mscx5_a9e6a719-71bb-4b65-9963-7050f9658dbb/kube-auth-proxy/0.log" Jun 09 01:55:01.944540 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:01.944511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/kube-multus-additional-cni-plugins/0.log" Jun 09 01:55:01.967131 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:01.967105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/egress-router-binary-copy/0.log" Jun 09 01:55:01.991667 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:01.991634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/cni-plugins/0.log" Jun 09 01:55:02.012747 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.012719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/bond-cni-plugin/0.log" Jun 09 01:55:02.035840 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.035811 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/routeoverride-cni/0.log" Jun 09 01:55:02.057847 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.057821 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/whereabouts-cni-bincopy/0.log" Jun 09 01:55:02.077937 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.077912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22w6m_d60e6bc1-55de-4238-9ca5-cbaba16d5c37/whereabouts-cni/0.log" Jun 09 01:55:02.463315 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.463289 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h8nn4_78590a40-2814-4aa6-b641-5ebe8fef8959/kube-multus/0.log" Jun 09 01:55:02.553035 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.553004 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89hqz_469e649f-3a27-4ccf-93c3-8bc1398f1136/network-metrics-daemon/0.log" Jun 09 01:55:02.579898 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.579872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89hqz_469e649f-3a27-4ccf-93c3-8bc1398f1136/kube-rbac-proxy/0.log" Jun 09 01:55:02.956400 ip-10-0-129-196 kubenswrapper[2576]: I0609 01:55:02.956368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c846984dd-mscx5_a9e6a719-71bb-4b65-9963-7050f9658dbb/kube-auth-proxy/0.log"