Jun 09 02:17:00.630974 ip-10-0-133-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 02:17:00.630985 ip-10-0-133-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 02:17:00.630992 ip-10-0-133-232 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 02:17:00.631247 ip-10-0-133-232 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 02:17:12.297253 ip-10-0-133-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 02:17:12.297270 ip-10-0-133-232 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 452089b9dab44e1986e564f6913cae33 -- Jun 09 02:19:32.996201 ip-10-0-133-232 systemd[1]: Starting Kubernetes Kubelet... Jun 09 02:19:33.445670 ip-10-0-133-232 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:33.445670 ip-10-0-133-232 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 02:19:33.445670 ip-10-0-133-232 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:33.445670 ip-10-0-133-232 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 02:19:33.445670 ip-10-0-133-232 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:33.447786 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.447635 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 02:19:33.452768 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452748 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.452768 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452767 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.452768 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452771 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452775 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452778 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452780 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452784 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452786 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452789 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452792 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452795 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452797 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452813 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452815 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452818 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452820 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452823 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452828 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452830 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452833 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452835 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.452883 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452838 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452849 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452851 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452854 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452857 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452859 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452862 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452865 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452868 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452870 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452872 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452875 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452878 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452881 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452883 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452887 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452890 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452893 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452895 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452898 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.453311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452901 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452903 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452906 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452908 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452911 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452913 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452916 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452919 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452921 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452926 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452930 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452933 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452936 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452939 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452942 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452945 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452948 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452950 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452953 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.453766 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452956 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452960 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452963 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452966 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452969 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452972 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452975 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452977 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452981 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452985 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452988 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452990 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452993 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452996 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.452999 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453002 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453005 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453008 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453010 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.454209 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453012 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453015 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453018 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453020 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453022 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453025 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453028 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453030 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453033 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453035 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453038 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453041 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453045 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453052 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453054 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453057 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453060 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453062 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453064 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.454643 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453754 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453761 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453764 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453766 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453769 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453772 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453775 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453778 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453781 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453783 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453786 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453789 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453791 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453794 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453796 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453798 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453816 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453819 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453822 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453824 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.455132 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453827 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453829 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453833 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453835 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453838 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453841 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453844 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453846 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453849 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453851 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453854 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453857 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453859 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453862 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453864 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453866 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453869 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453872 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453874 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453877 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.455642 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453879 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453881 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453884 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453886 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453889 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453891 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453894 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453896 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453898 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453901 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453903 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453908 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453911 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453913 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453916 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453920 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453923 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453925 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453928 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.456130 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453930 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453932 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453935 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453937 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453940 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453943 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453945 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453947 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453950 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453952 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453955 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453957 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453960 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453962 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453966 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453970 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453973 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453976 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453978 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.456582 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453983 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453986 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453989 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453992 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453995 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.453998 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454000 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454003 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454006 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454008 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454011 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454014 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454017 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454019 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454022 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454024 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454026 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454029 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454031 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454034 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.457038 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454036 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454408 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454413 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454415 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454418 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454420 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454423 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454426 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454428 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454431 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454433 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454435 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454438 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454440 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454445 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454448 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454451 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454454 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454457 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.457513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454460 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454463 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454465 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454468 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454471 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454473 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454476 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454478 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454481 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454483 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454486 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454488 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454491 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454493 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454495 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454498 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454500 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454503 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454505 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454507 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.458010 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454510 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454512 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454514 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454517 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454519 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454522 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454524 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454527 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454529 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454531 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454534 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454536 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454539 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454542 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454544 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454546 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454550 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454552 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454554 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454557 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.458486 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454559 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454561 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454564 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454567 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454570 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454572 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454575 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454577 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454579 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454581 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454584 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454586 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454588 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454591 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454593 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454595 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454598 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454600 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454603 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.458978 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454606 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454609 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454612 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454616 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454619 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454622 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454625 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454627 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454629 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454632 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454635 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454637 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454640 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454642 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454644 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454647 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454649 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454652 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454656 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.459412 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454659 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454661 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.454664 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454744 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454755 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454765 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454771 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454778 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454781 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454786 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454790 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454793 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454796 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454812 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454815 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454819 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454822 2565 flags.go:64] FLAG: --cgroup-root="" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454825 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454828 2565 flags.go:64] FLAG: --client-ca-file="" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454830 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454833 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454838 2565 flags.go:64] FLAG: --cluster-domain="" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454840 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454843 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 02:19:33.459870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454846 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454849 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454853 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454856 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454859 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454862 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454865 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454867 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454870 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454873 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454876 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454880 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454883 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454886 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454888 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454891 2565 flags.go:64] FLAG: --enable-server="true" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454894 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454897 2565 flags.go:64] FLAG: --event-burst="100" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454900 2565 flags.go:64] FLAG: --event-qps="50" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454903 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454905 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454914 2565 flags.go:64] FLAG: --eviction-hard="" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454918 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454920 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454923 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 02:19:33.460435 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454927 2565 flags.go:64] FLAG: --eviction-soft="" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454930 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454934 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454937 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454939 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454942 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454945 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454948 2565 flags.go:64] FLAG: --feature-gates="" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454952 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454955 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454958 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454961 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454964 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454967 2565 flags.go:64] FLAG: --help="false" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454970 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454972 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454975 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454978 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454981 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454984 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454987 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454990 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454992 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 02:19:33.461035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454995 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.454998 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455001 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455004 2565 flags.go:64] FLAG: --kube-reserved="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455007 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455011 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455014 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455017 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455019 2565 flags.go:64] FLAG: --lock-file="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455022 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455025 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455030 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455035 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455038 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455040 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455043 2565 flags.go:64] FLAG: --logging-format="text" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455046 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455050 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455053 2565 flags.go:64] FLAG: --manifest-url="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455056 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455060 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455063 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455067 2565 flags.go:64] FLAG: --max-pods="110" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455070 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455073 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 02:19:33.461643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455075 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455078 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455081 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455084 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455087 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455094 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455096 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455099 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455102 2565 flags.go:64] FLAG: --pod-cidr="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455105 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455110 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455113 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455117 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455120 2565 flags.go:64] FLAG: --port="10250" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455123 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455126 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b6057d1fb695ba60" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455129 2565 flags.go:64] FLAG: --qos-reserved="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455132 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455140 2565 flags.go:64] FLAG: --register-node="true" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455142 2565 flags.go:64] FLAG: --register-with-taints="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455146 2565 flags.go:64] FLAG: --registry-burst="10" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455149 2565 flags.go:64] FLAG: --registry-qps="5" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455152 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455155 2565 flags.go:64] FLAG: --reserved-memory="" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455158 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 02:19:33.462468 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455161 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455165 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455168 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455171 2565 flags.go:64] FLAG: --runonce="false" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455173 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455176 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455179 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455182 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455184 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455187 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455190 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455193 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455196 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455199 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455201 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455204 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455207 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455210 2565 flags.go:64] FLAG: --system-cgroups="" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455213 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455218 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455223 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455225 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455229 2565 flags.go:64] FLAG: --tls-min-version="" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455232 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455235 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 02:19:33.463282 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455239 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455242 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455245 2565 flags.go:64] FLAG: --v="2" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455252 2565 flags.go:64] FLAG: --version="false" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455256 2565 flags.go:64] FLAG: --vmodule="" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455260 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455263 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455382 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455386 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455389 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455392 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455394 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455397 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455399 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455402 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455405 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455407 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455409 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455412 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455414 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455417 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.463892 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455419 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455421 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455424 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455426 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455429 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455431 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455435 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455438 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455440 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455443 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455447 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455452 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455454 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455457 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455460 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455462 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455465 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455467 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455470 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455472 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.464382 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455475 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455477 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455480 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455482 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455485 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455487 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455489 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455492 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455494 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455497 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455499 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455501 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455504 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455506 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455508 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455510 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455513 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455515 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455519 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455521 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.464962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455525 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455528 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455531 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455534 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455537 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455540 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455542 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455545 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455547 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455550 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455552 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455555 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455557 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455560 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455562 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455565 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455567 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455569 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455572 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.465449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455574 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455577 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455581 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455584 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455587 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455589 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455592 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455595 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455597 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455599 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455602 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455606 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455608 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455611 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455613 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455616 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455619 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455622 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455624 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.465906 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455627 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455629 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455631 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455634 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455636 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455639 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.455641 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.455647 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.464302 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.464319 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.465252 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.465263 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465319 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465324 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465327 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.466341 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465332 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465336 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465339 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465342 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465344 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465347 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465350 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465353 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465356 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465359 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465362 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465364 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465367 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465370 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465373 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465376 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465378 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465382 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465386 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465389 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.466704 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465391 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465394 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465396 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465399 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465401 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465404 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465407 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465410 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465413 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465416 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465418 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465421 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465423 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465426 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465429 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465431 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465433 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465436 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465438 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.467239 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465441 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465443 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465446 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465448 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465452 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465455 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465458 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465461 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465463 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465466 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465469 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465473 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465476 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465479 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465481 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465484 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465486 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465489 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465491 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465495 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.467689 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465497 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465500 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465503 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465505 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465508 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465510 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465513 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465515 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465518 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465520 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465523 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465525 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465528 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465530 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465532 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465535 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465537 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465540 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465543 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465545 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.468165 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465547 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465550 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465552 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465555 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465557 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465559 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465562 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465564 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465567 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465569 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465572 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465575 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465577 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465580 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465582 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465585 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.468650 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465587 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.465592 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465706 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465710 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465713 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465715 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465718 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465721 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465723 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465726 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465728 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465731 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465734 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465737 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465742 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:33.469151 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465745 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465747 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465750 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465752 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465755 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465757 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465760 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465762 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465765 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465767 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465769 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465772 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465774 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465777 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465779 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465781 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465784 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465786 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465788 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465791 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:33.469540 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465793 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465796 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465798 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465818 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465821 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465824 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465826 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465829 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465832 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465835 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465837 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465840 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465844 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465847 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465849 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465852 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465854 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465856 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465859 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465861 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:33.470018 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465864 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465866 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465869 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465871 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465874 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465876 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465878 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465881 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465883 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465886 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465889 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465891 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465893 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465896 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465898 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465900 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465903 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465905 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465907 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:33.470504 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465910 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465913 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465915 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465918 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465921 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465923 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465927 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465931 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465934 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465938 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465941 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465944 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465946 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465949 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465952 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465955 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465958 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465960 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465963 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:33.470962 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465965 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465968 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465970 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465973 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465976 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465979 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465982 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:33.465984 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.465989 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.466106 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.468507 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.470186 2565 server.go:1019] "Starting client certificate rotation" Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.470285 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:19:33.471419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.470318 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:19:33.473117 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.473103 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:19:33.474237 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.474219 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:19:33.490958 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.490937 2565 log.go:25] "Validated CRI v1 runtime API" Jun 09 02:19:33.494132 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.494118 2565 log.go:25] "Validated CRI v1 image API" Jun 09 02:19:33.497771 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.497754 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 02:19:33.501980 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.501962 2565 fs.go:135] Filesystem UUIDs: map[603ca2fa-e4fc-4569-b369-5cf6028e173f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ca8309d0-b62e-44b0-a4b9-047140bd0945:/dev/nvme0n1p3] Jun 09 02:19:33.502038 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.501986 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 02:19:33.510162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.510016 2565 manager.go:216] Machine: {Timestamp:2026-06-09 02:19:33.508542912 +0000 UTC m=+0.376553775 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204992 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec229756d3239143ac8525aeaf100814 SystemUUID:ec229756-d323-9143-ac85-25aeaf100814 BootID:452089b9-dab4-4e19-86e5-64f6913cae33 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:d7:19:73:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:d7:19:73:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:98:9a:9e:32:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 02:19:33.510162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.510147 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 02:19:33.510319 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.510194 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:19:33.510319 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.510239 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 02:19:33.513979 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.513951 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 02:19:33.514115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.513982 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 02:19:33.514839 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.514828 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 02:19:33.514870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.514842 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 02:19:33.514870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.514850 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:19:33.514870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.514864 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:19:33.516162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.516152 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 02:19:33.520684 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520671 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:19:33.520833 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520822 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 02:19:33.520870 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520858 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 09 02:19:33.520918 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520872 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 02:19:33.520918 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520897 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 02:19:33.520918 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520910 2565 kubelet.go:398] "Adding apiserver pod source" Jun 09 02:19:33.520918 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.520919 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 02:19:33.521335 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.521319 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:19:33.521388 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.521348 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:19:33.524540 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.524520 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 02:19:33.526253 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.526239 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 02:19:33.526300 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.526271 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 02:19:33.527676 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527662 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527686 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527693 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527699 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527708 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527713 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527721 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 02:19:33.527727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527726 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 02:19:33.527966 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527733 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 02:19:33.527966 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527739 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 02:19:33.527966 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527752 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 02:19:33.527966 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.527758 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 02:19:33.529585 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.529574 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 02:19:33.529585 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.529585 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 02:19:33.533045 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.533027 2565 server.go:1268] "Started kubelet" Jun 09 02:19:33.533150 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.533048 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 02:19:33.533150 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.533061 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 02:19:33.533150 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.533138 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 02:19:33.533304 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.533112 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 02:19:33.533797 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.533353 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 02:19:33.533797 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.533673 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 02:19:33.534080 ip-10-0-133-232 systemd[1]: Started Kubernetes Kubelet. Jun 09 02:19:33.535411 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.535398 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 09 02:19:33.536198 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.536165 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 02:19:33.539111 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.537829 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-232.ec2.internal.18b74835cb80c8b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-232.ec2.internal,UID:ip-10-0-133-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-232.ec2.internal,},FirstTimestamp:2026-06-09 02:19:33.533001913 +0000 UTC m=+0.401012822,LastTimestamp:2026-06-09 02:19:33.533001913 +0000 UTC m=+0.401012822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-232.ec2.internal,}" Jun 09 02:19:33.543027 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.543001 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 02:19:33.543164 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.543144 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 02:19:33.543164 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.543154 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 02:19:33.543311 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.543271 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:33.543972 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.543943 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 02:19:33.544066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.543976 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 02:19:33.544066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.543989 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 02:19:33.544066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544038 2565 factory.go:55] Registering systemd factory Jun 09 02:19:33.544197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544075 2565 factory.go:223] Registration of the systemd container factory successfully Jun 09 02:19:33.544197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544114 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 09 02:19:33.544197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544125 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 09 02:19:33.544344 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544291 2565 factory.go:153] Registering CRI-O factory Jun 09 02:19:33.544344 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544307 2565 factory.go:223] Registration of the crio container factory successfully Jun 09 02:19:33.544437 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544360 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 02:19:33.544437 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544387 2565 factory.go:103] Registering Raw factory Jun 09 02:19:33.544437 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544402 2565 manager.go:1196] Started watching for new ooms in manager Jun 09 02:19:33.544821 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.544791 2565 manager.go:349] Starting recovery of all containers Jun 09 02:19:33.545464 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.545442 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 02:19:33.549559 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.549278 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6665x" Jun 09 02:19:33.555518 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.555497 2565 manager.go:354] Recovery completed Jun 09 02:19:33.556603 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.556583 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6665x" Jun 09 02:19:33.560337 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.560325 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.562269 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.562256 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:33.564393 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564379 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.564448 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564406 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.564448 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564421 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.564976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564964 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 02:19:33.564976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564975 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 02:19:33.565057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564975 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.565057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.564990 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:19:33.565669 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.565654 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.565720 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.565679 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.565720 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.565688 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.566965 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.566953 2565 policy_none.go:49] "None policy: Start" Jun 09 02:19:33.566999 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.566969 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 02:19:33.566999 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.566979 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 02:19:33.568714 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.568705 2565 policy_none.go:47] "Start" Jun 09 02:19:33.605457 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.605427 2565 manager.go:337] "Starting Device Plugin manager" Jun 09 02:19:33.605457 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.605460 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 02:19:33.605643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.605470 2565 server.go:87] "Starting device plugin registration server" Jun 09 02:19:33.605691 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.605681 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 02:19:33.605773 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.605690 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 02:19:33.606043 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.605960 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 02:19:33.606043 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.606031 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 02:19:33.606043 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.606040 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 02:19:33.606582 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.606559 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 02:19:33.606668 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.606610 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:33.629063 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.629035 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 02:19:33.637086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.630363 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 02:19:33.637086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.630396 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 02:19:33.637086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.630420 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 02:19:33.637086 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.630491 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 02:19:33.637086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.632759 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:33.705924 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.705843 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.706819 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.706783 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.706908 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.706829 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.706908 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.706839 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.706908 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.706865 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.716290 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.716267 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.716290 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.716292 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-232.ec2.internal\": node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:33.731431 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.731379 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal"] Jun 09 02:19:33.731588 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.731466 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.732413 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.732395 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.732524 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.732429 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.732524 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.732443 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.735031 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735014 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.735123 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735114 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.735168 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735141 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.735855 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735839 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.735855 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735846 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.735976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735875 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.735976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735884 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.735976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735861 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.735976 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.735935 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.738698 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.738683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.738759 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.738711 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:33.739876 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.739860 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:33.741958 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.741941 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:33.742038 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.741970 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:33.742038 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.741980 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:33.745416 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.745396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.745491 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.745428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.745491 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.745456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf289ebef9629ba86a70af54a7ac16a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-232.ec2.internal\" (UID: \"fdf289ebef9629ba86a70af54a7ac16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.753475 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.753457 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-232.ec2.internal\" not found" node="ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.759496 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.759474 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-232.ec2.internal\" not found" node="ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.840609 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.840571 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:33.845920 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.845896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.846008 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.845928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.846008 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.845949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf289ebef9629ba86a70af54a7ac16a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-232.ec2.internal\" (UID: \"fdf289ebef9629ba86a70af54a7ac16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.846008 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.845984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.846125 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.846024 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfcfd441475ee8fbb0958785e6638c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal\" (UID: \"ecfcfd441475ee8fbb0958785e6638c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.846125 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:33.845984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf289ebef9629ba86a70af54a7ac16a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-232.ec2.internal\" (UID: \"fdf289ebef9629ba86a70af54a7ac16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:33.941083 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:33.941039 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.041869 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.041762 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.060298 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.060268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:34.066440 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.066407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:34.142302 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.142100 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.242622 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.242592 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.343180 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.343115 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.443702 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.443671 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.470077 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.470052 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 02:19:34.470741 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.470211 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:19:34.470741 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.470237 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:19:34.517968 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.517937 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:34.543897 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.543859 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.560893 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.560858 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 02:14:33 +0000 UTC" deadline="2028-02-10 11:32:31.880740462 +0000 UTC" Jun 09 02:19:34.560893 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.560888 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14673h12m57.319855695s" Jun 09 02:19:34.618688 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:34.618655 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfcfd441475ee8fbb0958785e6638c8.slice/crio-e5c3072edc53c3c40a7de42a801eee4e4bb49af527ae81655887a76a0929ce2e WatchSource:0}: Error finding container e5c3072edc53c3c40a7de42a801eee4e4bb49af527ae81655887a76a0929ce2e: Status 404 returned error can't find the container with id e5c3072edc53c3c40a7de42a801eee4e4bb49af527ae81655887a76a0929ce2e Jun 09 02:19:34.621171 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:34.621133 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf289ebef9629ba86a70af54a7ac16a.slice/crio-12191be21759759c579410003b2ecd79d07a79c8c2858f6ff09a3e6c61d7942e WatchSource:0}: Error finding container 12191be21759759c579410003b2ecd79d07a79c8c2858f6ff09a3e6c61d7942e: Status 404 returned error can't find the container with id 12191be21759759c579410003b2ecd79d07a79c8c2858f6ff09a3e6c61d7942e Jun 09 02:19:34.626535 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.626517 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:19:34.634497 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.634452 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" event={"ID":"fdf289ebef9629ba86a70af54a7ac16a","Type":"ContainerStarted","Data":"12191be21759759c579410003b2ecd79d07a79c8c2858f6ff09a3e6c61d7942e"} Jun 09 02:19:34.635455 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:34.635433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" event={"ID":"ecfcfd441475ee8fbb0958785e6638c8","Type":"ContainerStarted","Data":"e5c3072edc53c3c40a7de42a801eee4e4bb49af527ae81655887a76a0929ce2e"} Jun 09 02:19:34.644537 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.644510 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.745016 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.744981 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.845468 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.845434 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:34.946037 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:34.946008 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-232.ec2.internal\" not found" Jun 09 02:19:35.001978 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.001948 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:35.044133 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.044101 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" Jun 09 02:19:35.056165 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.056142 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:19:35.057074 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.057060 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" Jun 09 02:19:35.067075 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.067049 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:19:35.521599 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.521553 2565 apiserver.go:52] "Watching apiserver" Jun 09 02:19:35.529779 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.529753 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 02:19:35.533678 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.533644 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-vbps4","openshift-multus/network-metrics-daemon-cdmms","openshift-network-diagnostics/network-check-target-87sz6","openshift-ovn-kubernetes/ovnkube-node-9qgk7","kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hkft8","openshift-dns/node-resolver-qkxtz","openshift-image-registry/node-ca-lpnbh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal","openshift-network-operator/iptables-alerter-jbc56","kube-system/global-pull-secret-syncer-g59z2","kube-system/konnectivity-agent-vk9kz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65","openshift-multus/multus-6j5mp"] Jun 09 02:19:35.536566 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.536545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.540655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.538698 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.540655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.538940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xcx7l\"" Jun 09 02:19:35.540655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.539113 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 02:19:35.540655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.539175 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.540655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.539298 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.541061 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.540819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5njtt\"" Jun 09 02:19:35.541061 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.540827 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.541061 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.540878 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:35.541061 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.540936 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:35.541061 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.540964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 02:19:35.541294 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.541106 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.543609 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.543067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.545354 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.543948 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 02:19:35.545757 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.545607 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8qkmm\"" Jun 09 02:19:35.545850 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.545783 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 02:19:35.545999 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.545978 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 02:19:35.547333 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.547308 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.549817 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.549781 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fmjz\"" Jun 09 02:19:35.549988 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.549969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.550066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.550031 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.550167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.550154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.551828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.551776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.551915 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.551877 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:35.552698 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.552681 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.553301 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.553072 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h5sqm\"" Jun 09 02:19:35.553392 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.553164 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.554330 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkvjx\" (UniqueName: \"kubernetes.io/projected/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-kube-api-access-nkvjx\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.554422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-iptables-alerter-script\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.554422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-socket-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-device-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntm9\" (UniqueName: \"kubernetes.io/projected/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kube-api-access-jntm9\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa1c0173-56da-4808-8322-3e6d029d848d-agent-certs\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-registration-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa1c0173-56da-4808-8322-3e6d029d848d-konnectivity-ca\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9294c4c-5b86-47ad-93be-d948e2111f37-tmp-dir\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s528\" (UniqueName: \"kubernetes.io/projected/a9294c4c-5b86-47ad-93be-d948e2111f37-kube-api-access-2s528\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-host-slash\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.554633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-sys-fs\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.554996 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:35.554996 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.554663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9294c4c-5b86-47ad-93be-d948e2111f37-hosts-file\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.555220 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.555197 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.555309 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.555266 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:35.556382 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.556350 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:19:35.559419 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.557538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.560090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.560205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.560614 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g9dqp\"" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.560643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.561052 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.561111 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.561205 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.561114 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 02:19:35.562911 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.562894 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 02:19:35.563086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.563067 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4nqj\"" Jun 09 02:19:35.563318 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.563304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 02:19:35.563543 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.563319 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.563762 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.563744 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.564379 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.564358 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 02:19:35.564464 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.564398 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.564464 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.564448 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 02:19:35.565907 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.565878 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 02:19:35.565907 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.565891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.566225 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.566205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 02:19:35.566307 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.566243 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 02:19:35.566769 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.566749 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-884s2\"" Jun 09 02:19:35.569132 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.568721 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lhbfv\"" Jun 09 02:19:35.569132 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.568947 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 02:19:35.576460 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.576436 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5vdx" Jun 09 02:19:35.586730 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.586698 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5vdx" Jun 09 02:19:35.645228 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.645202 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 02:19:35.654936 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.654904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-registration-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.654936 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.654944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9294c4c-5b86-47ad-93be-d948e2111f37-tmp-dir\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.654972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s528\" (UniqueName: \"kubernetes.io/projected/a9294c4c-5b86-47ad-93be-d948e2111f37-kube-api-access-2s528\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-slash\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-host-slash\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfs9m\" (UniqueName: \"kubernetes.io/projected/55bee08e-6972-446c-a808-67de240e2201-kube-api-access-xfs9m\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-systemd-units\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-bin\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-bin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-kubelet\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkvjx\" (UniqueName: \"kubernetes.io/projected/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-kube-api-access-nkvjx\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-systemd\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9294c4c-5b86-47ad-93be-d948e2111f37-tmp-dir\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-netd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-env-overrides\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-os-release\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-multus-certs\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-socket-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gdv6\" (UniqueName: \"kubernetes.io/projected/03529f88-6f83-4511-993e-0cfafdb127e5-kube-api-access-4gdv6\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-system-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.655550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa1c0173-56da-4808-8322-3e6d029d848d-konnectivity-ca\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-run\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-systemd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-sys-fs\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-log-socket\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-os-release\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gd7q\" (UniqueName: \"kubernetes.io/projected/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-kube-api-access-5gd7q\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-kubelet\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-ovn\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc8b9176-454b-4507-8d60-a49a1356b2d7-serviceca\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-hostroot\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-daemon-config\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-device-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-tmp\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-system-cni-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-host-slash\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc8b9176-454b-4507-8d60-a49a1356b2d7-host\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-k8s-cni-cncf-io\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqcms\" (UniqueName: \"kubernetes.io/projected/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-kube-api-access-lqcms\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-var-lib-kubelet\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-host\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-multus\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-conf-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9294c4c-5b86-47ad-93be-d948e2111f37-hosts-file\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656350 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9294c4c-5b86-47ad-93be-d948e2111f37-hosts-file\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-conf\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-etc-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.656932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-socket-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-sys\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-etc-tuned\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.655564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-registration-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-dbus\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-device-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cnibin\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-config\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-sys-fs\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-script-lib\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jntm9\" (UniqueName: \"kubernetes.io/projected/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kube-api-access-jntm9\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-kubernetes\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-kubelet-config\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-netns\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79dd\" (UniqueName: \"kubernetes.io/projected/f7f518ba-c1f1-4714-ba72-40422d175ba6-kube-api-access-d79dd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.657708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62965\" (UniqueName: \"kubernetes.io/projected/cc8b9176-454b-4507-8d60-a49a1356b2d7-kube-api-access-62965\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cni-binary-copy\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-socket-dir-parent\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysconfig\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-lib-modules\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-var-lib-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-node-log\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-etc-kubernetes\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-modprobe-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa1c0173-56da-4808-8322-3e6d029d848d-konnectivity-ca\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cnibin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-netns\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.656755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.658429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-iptables-alerter-script\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.659211 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.657778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa1c0173-56da-4808-8322-3e6d029d848d-agent-certs\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.659211 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.658059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.659211 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.658157 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 02:19:35.659211 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.658790 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-iptables-alerter-script\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.663314 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.663270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa1c0173-56da-4808-8322-3e6d029d848d-agent-certs\") pod \"konnectivity-agent-vk9kz\" (UID: \"fa1c0173-56da-4808-8322-3e6d029d848d\") " pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.663975 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.663953 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:35.664136 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.664114 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:35.664227 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.664217 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:35.664417 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.664403 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:36.16437047 +0000 UTC m=+3.032381342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:35.664510 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.664431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkvjx\" (UniqueName: \"kubernetes.io/projected/3cc9a297-1ffe-4b2f-909e-7d09363a37d3-kube-api-access-nkvjx\") pod \"iptables-alerter-jbc56\" (UID: \"3cc9a297-1ffe-4b2f-909e-7d09363a37d3\") " pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.664595 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.664269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s528\" (UniqueName: \"kubernetes.io/projected/a9294c4c-5b86-47ad-93be-d948e2111f37-kube-api-access-2s528\") pod \"node-resolver-qkxtz\" (UID: \"a9294c4c-5b86-47ad-93be-d948e2111f37\") " pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.667977 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.667955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntm9\" (UniqueName: \"kubernetes.io/projected/e0b02a95-2bcf-43c5-b07c-bce0b24ae19b-kube-api-access-jntm9\") pod \"aws-ebs-csi-driver-node-fdt65\" (UID: \"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.694034 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.693996 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:35.759095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-modprobe-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.759095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cnibin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-netns\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-netns\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759201 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cnibin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-slash\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759279 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-modprobe-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfs9m\" (UniqueName: \"kubernetes.io/projected/55bee08e-6972-446c-a808-67de240e2201-kube-api-access-xfs9m\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-systemd-units\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-slash\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-bin\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-bin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-kubelet\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-systemd\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-systemd-units\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-bin\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759470 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-netd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-cni-netd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-systemd\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-kubelet\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-env-overrides\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.759764 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-bin\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-os-release\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-multus-certs\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gdv6\" (UniqueName: \"kubernetes.io/projected/03529f88-6f83-4511-993e-0cfafdb127e5-kube-api-access-4gdv6\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-multus-certs\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-os-release\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.759691 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-system-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-run\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.759752 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:36.259737433 +0000 UTC m=+3.127748283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-run\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-systemd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-systemd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-log-socket\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-system-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.760550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-os-release\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-log-socket\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.759950 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-os-release\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gd7q\" (UniqueName: \"kubernetes.io/projected/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-kube-api-access-5gd7q\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.759986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-env-overrides\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:35.760005 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:19:36.259989942 +0000 UTC m=+3.128000792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-kubelet\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-ovn\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc8b9176-454b-4507-8d60-a49a1356b2d7-serviceca\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-kubelet\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-hostroot\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-daemon-config\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-run-ovn\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-tmp\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-hostroot\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.761370 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-system-cni-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc8b9176-454b-4507-8d60-a49a1356b2d7-host\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-k8s-cni-cncf-io\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqcms\" (UniqueName: \"kubernetes.io/projected/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-kube-api-access-lqcms\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc8b9176-454b-4507-8d60-a49a1356b2d7-host\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-var-lib-kubelet\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-host\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-var-lib-kubelet\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-multus\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-conf-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-conf\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-d\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-run-k8s-cni-cncf-io\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-daemon-config\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc8b9176-454b-4507-8d60-a49a1356b2d7-serviceca\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.762167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-etc-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-host\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-sys\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-etc-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-etc-tuned\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760797 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-conf-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-dbus\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cnibin\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-host-var-lib-cni-multus\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-config\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-script-lib\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-kubernetes\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-sys\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-kubelet-config\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysctl-conf\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-system-cni-dir\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-netns\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.762881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.760997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-kubelet-config\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79dd\" (UniqueName: \"kubernetes.io/projected/f7f518ba-c1f1-4714-ba72-40422d175ba6-kube-api-access-d79dd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62965\" (UniqueName: \"kubernetes.io/projected/cc8b9176-454b-4507-8d60-a49a1356b2d7-kube-api-access-62965\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-netns\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cni-binary-copy\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-cni-binary-copy\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-socket-dir-parent\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysconfig\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-lib-modules\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-var-lib-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-node-log\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-kubernetes\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-etc-kubernetes\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.763521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-script-lib\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761904 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-cni-dir\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761957 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-multus-socket-dir-parent\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b858869-7a1b-4979-bbee-fdcf55692c2d-dbus\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.761966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovnkube-config\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-etc-sysconfig\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762018 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-node-log\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762046 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-var-lib-openvswitch\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-cnibin\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-etc-kubernetes\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bee08e-6972-446c-a808-67de240e2201-lib-modules\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.762087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f518ba-c1f1-4714-ba72-40422d175ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.763124 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-tmp\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.764114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.763862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7f518ba-c1f1-4714-ba72-40422d175ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.764912 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.764891 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55bee08e-6972-446c-a808-67de240e2201-etc-tuned\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.771007 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.770975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gdv6\" (UniqueName: \"kubernetes.io/projected/03529f88-6f83-4511-993e-0cfafdb127e5-kube-api-access-4gdv6\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:35.771337 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.771302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gd7q\" (UniqueName: \"kubernetes.io/projected/5a5c23a7-4eae-4ba0-904d-e875493a6c1e-kube-api-access-5gd7q\") pod \"multus-additional-cni-plugins-vbps4\" (UID: \"5a5c23a7-4eae-4ba0-904d-e875493a6c1e\") " pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.771587 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.771568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfs9m\" (UniqueName: \"kubernetes.io/projected/55bee08e-6972-446c-a808-67de240e2201-kube-api-access-xfs9m\") pod \"tuned-hkft8\" (UID: \"55bee08e-6972-446c-a808-67de240e2201\") " pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.773037 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.772981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqcms\" (UniqueName: \"kubernetes.io/projected/bdf350e6-7f2a-49e3-a2d4-753ff5fff0da-kube-api-access-lqcms\") pod \"multus-6j5mp\" (UID: \"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da\") " pod="openshift-multus/multus-6j5mp" Jun 09 02:19:35.773458 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.773442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62965\" (UniqueName: \"kubernetes.io/projected/cc8b9176-454b-4507-8d60-a49a1356b2d7-kube-api-access-62965\") pod \"node-ca-lpnbh\" (UID: \"cc8b9176-454b-4507-8d60-a49a1356b2d7\") " pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.773554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.773528 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79dd\" (UniqueName: \"kubernetes.io/projected/f7f518ba-c1f1-4714-ba72-40422d175ba6-kube-api-access-d79dd\") pod \"ovnkube-node-9qgk7\" (UID: \"f7f518ba-c1f1-4714-ba72-40422d175ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.849565 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.849534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jbc56" Jun 09 02:19:35.857998 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.857968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" Jun 09 02:19:35.872862 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.872830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:35.874892 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.874874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkxtz" Jun 09 02:19:35.883241 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.883212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkft8" Jun 09 02:19:35.889932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.889904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbps4" Jun 09 02:19:35.897768 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.897748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:19:35.905476 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.905455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpnbh" Jun 09 02:19:35.912253 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:35.912234 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j5mp" Jun 09 02:19:36.032081 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.031999 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:36.165358 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.165183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:36.165358 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.165350 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:36.165358 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.165372 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:36.165626 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.165382 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:36.165626 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.165432 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:37.165415647 +0000 UTC m=+4.033426509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:36.265579 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.265545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:36.265579 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.265587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:36.265779 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.265710 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:36.265779 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.265766 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:37.26575239 +0000 UTC m=+4.133763240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:36.265876 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.265710 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:36.265876 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.265847 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:19:37.265835349 +0000 UTC m=+4.133846215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:36.541071 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.541046 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc9a297_1ffe_4b2f_909e_7d09363a37d3.slice/crio-828697e9656f1a6cbb154bee894247d99bcbe11f91b50d52de58386297d39a05 WatchSource:0}: Error finding container 828697e9656f1a6cbb154bee894247d99bcbe11f91b50d52de58386297d39a05: Status 404 returned error can't find the container with id 828697e9656f1a6cbb154bee894247d99bcbe11f91b50d52de58386297d39a05 Jun 09 02:19:36.542369 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.542340 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b02a95_2bcf_43c5_b07c_bce0b24ae19b.slice/crio-e23dac2f48beb043294b605a235633428109459e64a3ef3df798bd67aa574cf5 WatchSource:0}: Error finding container e23dac2f48beb043294b605a235633428109459e64a3ef3df798bd67aa574cf5: Status 404 returned error can't find the container with id e23dac2f48beb043294b605a235633428109459e64a3ef3df798bd67aa574cf5 Jun 09 02:19:36.546012 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.545990 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9294c4c_5b86_47ad_93be_d948e2111f37.slice/crio-0f4e63ecb27c57d9b9889171ffd5b8b08501c5118910e4e5ea9737936f25df38 WatchSource:0}: Error finding container 0f4e63ecb27c57d9b9889171ffd5b8b08501c5118910e4e5ea9737936f25df38: Status 404 returned error can't find the container with id 0f4e63ecb27c57d9b9889171ffd5b8b08501c5118910e4e5ea9737936f25df38 Jun 09 02:19:36.569824 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.569784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8b9176_454b_4507_8d60_a49a1356b2d7.slice/crio-97cd0ac09d69983ee95e3e51eb6c48124fb35fca642bceb41b914eab6d7e5b8d WatchSource:0}: Error finding container 97cd0ac09d69983ee95e3e51eb6c48124fb35fca642bceb41b914eab6d7e5b8d: Status 404 returned error can't find the container with id 97cd0ac09d69983ee95e3e51eb6c48124fb35fca642bceb41b914eab6d7e5b8d Jun 09 02:19:36.571316 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.571300 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f518ba_c1f1_4714_ba72_40422d175ba6.slice/crio-3d373f2fb2d5b541964593c0e9537922d30c4785eb163cbb43822ca78b8d409a WatchSource:0}: Error finding container 3d373f2fb2d5b541964593c0e9537922d30c4785eb163cbb43822ca78b8d409a: Status 404 returned error can't find the container with id 3d373f2fb2d5b541964593c0e9537922d30c4785eb163cbb43822ca78b8d409a Jun 09 02:19:36.573095 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.573078 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5c23a7_4eae_4ba0_904d_e875493a6c1e.slice/crio-28dcffd0ae08a25681ce061a026af4cf0facdcd9ecdbf3a5203bb8ef4ee4aa5e WatchSource:0}: Error finding container 28dcffd0ae08a25681ce061a026af4cf0facdcd9ecdbf3a5203bb8ef4ee4aa5e: Status 404 returned error can't find the container with id 28dcffd0ae08a25681ce061a026af4cf0facdcd9ecdbf3a5203bb8ef4ee4aa5e Jun 09 02:19:36.575845 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.575818 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1c0173_56da_4808_8322_3e6d029d848d.slice/crio-5701a8130974202ecf1b814f3979827cd87275ccc2f5bef0798bf5d490d48dfd WatchSource:0}: Error finding container 5701a8130974202ecf1b814f3979827cd87275ccc2f5bef0798bf5d490d48dfd: Status 404 returned error can't find the container with id 5701a8130974202ecf1b814f3979827cd87275ccc2f5bef0798bf5d490d48dfd Jun 09 02:19:36.577571 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.577389 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bee08e_6972_446c_a808_67de240e2201.slice/crio-da26ba8ba99ebdf3582029b78594438a0b9a69537d3e185802fbbf88b1675f45 WatchSource:0}: Error finding container da26ba8ba99ebdf3582029b78594438a0b9a69537d3e185802fbbf88b1675f45: Status 404 returned error can't find the container with id da26ba8ba99ebdf3582029b78594438a0b9a69537d3e185802fbbf88b1675f45 Jun 09 02:19:36.578900 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:19:36.578879 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf350e6_7f2a_49e3_a2d4_753ff5fff0da.slice/crio-9bb7b5732433d91693d71e4a5a3aa7e12f5fa2798020deb54dac1ff6dc66b1fd WatchSource:0}: Error finding container 9bb7b5732433d91693d71e4a5a3aa7e12f5fa2798020deb54dac1ff6dc66b1fd: Status 404 returned error can't find the container with id 9bb7b5732433d91693d71e4a5a3aa7e12f5fa2798020deb54dac1ff6dc66b1fd Jun 09 02:19:36.591151 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.591110 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:14:35 +0000 UTC" deadline="2028-01-26 21:57:58.485237033 +0000 UTC" Jun 09 02:19:36.591151 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.591149 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14323h38m21.894089989s" Jun 09 02:19:36.630903 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.630876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:36.631007 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:36.630986 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:36.639630 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.639570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpnbh" event={"ID":"cc8b9176-454b-4507-8d60-a49a1356b2d7","Type":"ContainerStarted","Data":"97cd0ac09d69983ee95e3e51eb6c48124fb35fca642bceb41b914eab6d7e5b8d"} Jun 09 02:19:36.640627 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.640602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"3d373f2fb2d5b541964593c0e9537922d30c4785eb163cbb43822ca78b8d409a"} Jun 09 02:19:36.641733 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.641709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j5mp" event={"ID":"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da","Type":"ContainerStarted","Data":"9bb7b5732433d91693d71e4a5a3aa7e12f5fa2798020deb54dac1ff6dc66b1fd"} Jun 09 02:19:36.642651 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.642625 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerStarted","Data":"28dcffd0ae08a25681ce061a026af4cf0facdcd9ecdbf3a5203bb8ef4ee4aa5e"} Jun 09 02:19:36.643571 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.643552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkxtz" event={"ID":"a9294c4c-5b86-47ad-93be-d948e2111f37","Type":"ContainerStarted","Data":"0f4e63ecb27c57d9b9889171ffd5b8b08501c5118910e4e5ea9737936f25df38"} Jun 09 02:19:36.644496 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.644474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" event={"ID":"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b","Type":"ContainerStarted","Data":"e23dac2f48beb043294b605a235633428109459e64a3ef3df798bd67aa574cf5"} Jun 09 02:19:36.645454 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.645431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jbc56" event={"ID":"3cc9a297-1ffe-4b2f-909e-7d09363a37d3","Type":"ContainerStarted","Data":"828697e9656f1a6cbb154bee894247d99bcbe11f91b50d52de58386297d39a05"} Jun 09 02:19:36.646406 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.646385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkft8" event={"ID":"55bee08e-6972-446c-a808-67de240e2201","Type":"ContainerStarted","Data":"da26ba8ba99ebdf3582029b78594438a0b9a69537d3e185802fbbf88b1675f45"} Jun 09 02:19:36.647387 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:36.647366 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vk9kz" event={"ID":"fa1c0173-56da-4808-8322-3e6d029d848d","Type":"ContainerStarted","Data":"5701a8130974202ecf1b814f3979827cd87275ccc2f5bef0798bf5d490d48dfd"} Jun 09 02:19:37.173209 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.173119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:37.173429 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.173302 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:37.173429 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.173323 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:37.173429 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.173335 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:37.173429 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.173393 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:39.173375649 +0000 UTC m=+6.041386516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:37.273988 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.273924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:37.273988 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.273987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:37.274258 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.274140 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:37.274258 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.274202 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:19:39.274184589 +0000 UTC m=+6.142195439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:37.274598 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.274577 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:37.274671 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.274632 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:39.274616623 +0000 UTC m=+6.142627479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:37.594292 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.592079 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:14:35 +0000 UTC" deadline="2027-11-03 18:37:06.891630446 +0000 UTC" Jun 09 02:19:37.594292 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.592122 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12304h17m29.299513744s" Jun 09 02:19:37.634235 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.631964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:37.634235 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.632016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:37.634235 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.632098 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:37.634235 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:37.632185 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:37.675786 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.675157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" event={"ID":"fdf289ebef9629ba86a70af54a7ac16a","Type":"ContainerStarted","Data":"b310704dacac111cbafe216de8d608dcb3a097c7a89c220964482b6585fcac56"} Jun 09 02:19:37.691129 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.688928 2565 generic.go:356] "Generic (PLEG): container finished" podID="ecfcfd441475ee8fbb0958785e6638c8" containerID="ac6beac5cc5e33dc9789482a7e668ea11fdd891754f5d0db2d9c516107919a99" exitCode=0 Jun 09 02:19:37.691129 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.688981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" event={"ID":"ecfcfd441475ee8fbb0958785e6638c8","Type":"ContainerDied","Data":"ac6beac5cc5e33dc9789482a7e668ea11fdd891754f5d0db2d9c516107919a99"} Jun 09 02:19:37.691129 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:37.690222 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-232.ec2.internal" podStartSLOduration=2.690204488 podStartE2EDuration="2.690204488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:37.689733855 +0000 UTC m=+4.557744726" watchObservedRunningTime="2026-06-09 02:19:37.690204488 +0000 UTC m=+4.558215361" Jun 09 02:19:38.633300 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:38.633039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:38.633740 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:38.633411 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:38.707902 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:38.707867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" event={"ID":"ecfcfd441475ee8fbb0958785e6638c8","Type":"ContainerStarted","Data":"921f4a42de6457ac0fae1259bea066793e452acb4710782344ea6300262a3f39"} Jun 09 02:19:39.195423 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:39.195256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:39.195597 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.195454 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:39.195597 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.195471 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:39.195597 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.195482 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:39.195597 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.195535 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:43.195517703 +0000 UTC m=+10.063528567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:39.296408 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:39.296372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:39.296587 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:39.296426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:39.296657 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.296614 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:39.296703 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.296676 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:19:43.296658142 +0000 UTC m=+10.164669011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:39.297217 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.297193 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:39.297331 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.297282 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:43.297265029 +0000 UTC m=+10.165275894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:39.632101 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:39.631918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:39.632101 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:39.631937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:39.632101 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.632023 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:39.632101 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:39.632090 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:40.631624 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:40.631578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:40.632130 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:40.631713 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:41.631521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:41.631487 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:41.631521 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:41.631517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:41.631993 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:41.631650 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:41.631993 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:41.631758 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:42.630716 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:42.630671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:42.630944 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:42.630825 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:43.230812 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:43.230759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:43.231269 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.230991 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:43.231269 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.231013 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:43.231269 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.231025 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:43.231269 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.231086 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:51.231067204 +0000 UTC m=+18.099078073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:43.331849 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:43.331794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:43.332041 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:43.331870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:43.332041 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.332034 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:43.332141 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.332107 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:19:51.332089262 +0000 UTC m=+18.200100131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:43.332527 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.332507 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:43.332608 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.332561 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:51.332545461 +0000 UTC m=+18.200556318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:43.631862 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:43.631622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:43.631862 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.631738 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:43.631862 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:43.631829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:43.632105 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:43.631958 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:44.630771 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:44.630736 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:44.631153 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:44.630892 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:45.631449 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:45.630913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:45.631449 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:45.631043 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:45.631968 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:45.631563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:45.631968 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:45.631676 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:46.631634 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:46.631592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:46.632160 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:46.631732 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:47.631379 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:47.631339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:47.631563 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:47.631356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:47.631563 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:47.631484 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:47.631563 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:47.631538 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:48.630901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:48.630868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:48.631345 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:48.630997 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:49.631097 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:49.630965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:49.631542 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:49.631100 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:49.631542 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:49.631157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:49.631542 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:49.631284 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:50.631403 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:50.631368 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:50.631763 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:50.631471 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:51.285847 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:51.285788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:51.286020 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.285955 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:51.286020 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.285977 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:51.286020 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.285989 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:51.286176 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.286057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:07.286037625 +0000 UTC m=+34.154048495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:51.386956 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:51.386922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:51.387134 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:51.386970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:51.387134 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.387100 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:51.387134 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.387101 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:51.387285 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.387170 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:20:07.387151461 +0000 UTC m=+34.255162314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:51.387285 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.387190 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:07.387179546 +0000 UTC m=+34.255190400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:51.631399 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:51.631314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:51.631542 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:51.631320 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:51.631542 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.631499 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:51.631939 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:51.631624 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:52.630989 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:52.630947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:52.631149 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:52.631081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:53.632031 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:53.631997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:53.632598 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:53.632102 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:53.632598 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:53.632163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:53.632598 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:53.632269 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:54.631193 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:54.631147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:54.631341 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:54.631265 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:55.631121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.630872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:55.631121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.630947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:55.631121 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:55.631107 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:55.631777 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:55.631213 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:55.746083 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.745531 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkft8" event={"ID":"55bee08e-6972-446c-a808-67de240e2201","Type":"ContainerStarted","Data":"a1197d87eebd905dcaba4d00aad4b89fe1ee80c915644ebe418d968c720d9400"} Jun 09 02:19:55.746951 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.746925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vk9kz" event={"ID":"fa1c0173-56da-4808-8322-3e6d029d848d","Type":"ContainerStarted","Data":"fa36a07d24af479d48d73b63665cb4b8a058686c286d591745fc6dbb4c0ff345"} Jun 09 02:19:55.748467 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.748445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpnbh" event={"ID":"cc8b9176-454b-4507-8d60-a49a1356b2d7","Type":"ContainerStarted","Data":"a6d90049e68056cf232e6b243235d06ec94b1ad46d457351f4ecefc2fd8f647e"} Jun 09 02:19:55.749989 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.749972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:19:55.750299 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.750277 2565 generic.go:356] "Generic (PLEG): container finished" podID="f7f518ba-c1f1-4714-ba72-40422d175ba6" containerID="75067f1a96dc53ea6909c1b9c08257b6a9a8fec940ce2edda7a00548d2887faf" exitCode=1 Jun 09 02:19:55.750374 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.750345 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerDied","Data":"75067f1a96dc53ea6909c1b9c08257b6a9a8fec940ce2edda7a00548d2887faf"} Jun 09 02:19:55.750430 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.750398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"3df4ff4e5295d1f7493358eeac9f97b6b264f5c5e1497f0af3e2adc760861a92"} Jun 09 02:19:55.751679 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.751648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j5mp" event={"ID":"bdf350e6-7f2a-49e3-a2d4-753ff5fff0da","Type":"ContainerStarted","Data":"50724625e26c1672d2bbd79de45dbf376eeb0183e63f6ff86d01023d363af8f9"} Jun 09 02:19:55.753054 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.753034 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="518f7897514d7b2b02935989fa80d13e72d5521289bb0ecd211e117e0bd8ba2b" exitCode=0 Jun 09 02:19:55.753139 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.753094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"518f7897514d7b2b02935989fa80d13e72d5521289bb0ecd211e117e0bd8ba2b"} Jun 09 02:19:55.754394 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.754371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkxtz" event={"ID":"a9294c4c-5b86-47ad-93be-d948e2111f37","Type":"ContainerStarted","Data":"73627780e4ded8b5e69d5f0a22ffaa83b406226ad273e9b1cdbb869cf070d62d"} Jun 09 02:19:55.755901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.755874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" event={"ID":"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b","Type":"ContainerStarted","Data":"a5fb7522e9e275b01e37be67b1169f3c8c5720d1edcdfae99371cc689879b3a2"} Jun 09 02:19:55.760681 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.760636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hkft8" podStartSLOduration=4.031269219 podStartE2EDuration="22.760625545s" totalImagesPullingTime="18.729356326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:55.760308454 +0000 UTC m=+22.628319324" watchObservedRunningTime="2026-06-09 02:19:55.760625545 +0000 UTC m=+22.628636479" Jun 09 02:19:55.760827 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.760781 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-232.ec2.internal" podStartSLOduration=20.760777287 podStartE2EDuration="20.760777287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:38.72240251 +0000 UTC m=+5.590413382" watchObservedRunningTime="2026-06-09 02:19:55.760777287 +0000 UTC m=+22.628788158" Jun 09 02:19:55.773124 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.773074 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lpnbh" podStartSLOduration=2.997531117 podStartE2EDuration="21.773056604s" totalImagesPullingTime="18.775525487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:55.772904055 +0000 UTC m=+22.640914960" watchObservedRunningTime="2026-06-09 02:19:55.773056604 +0000 UTC m=+22.641067478" Jun 09 02:19:55.822613 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.822517 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6j5mp" podStartSLOduration=3.033454767 podStartE2EDuration="21.822502017s" totalImagesPullingTime="18.78904725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:55.822439939 +0000 UTC m=+22.690450820" watchObservedRunningTime="2026-06-09 02:19:55.822502017 +0000 UTC m=+22.690512887" Jun 09 02:19:55.837420 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.837364 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vk9kz" podStartSLOduration=4.107910049 podStartE2EDuration="22.837343874s" totalImagesPullingTime="18.729433825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:55.837059983 +0000 UTC m=+22.705070851" watchObservedRunningTime="2026-06-09 02:19:55.837343874 +0000 UTC m=+22.705354778" Jun 09 02:19:55.850618 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:55.850573 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qkxtz" podStartSLOduration=4.069344967 podStartE2EDuration="22.850560191s" totalImagesPullingTime="18.781215224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:55.850299747 +0000 UTC m=+22.718310619" watchObservedRunningTime="2026-06-09 02:19:55.850560191 +0000 UTC m=+22.718571063" Jun 09 02:19:56.631708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.631508 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:56.632194 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:56.631792 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:56.759581 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.759547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jbc56" event={"ID":"3cc9a297-1ffe-4b2f-909e-7d09363a37d3","Type":"ContainerStarted","Data":"331d13b44a893613ff690b1993d90e20bd416d5eea867ab72bcf9b8c44310e8a"} Jun 09 02:19:56.762444 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.762420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:19:56.762939 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.762883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"afde2b79d6597bff3c39e24c962387454ba136d0e0859f893884d5cd34fb768c"} Jun 09 02:19:56.763040 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.762942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"5ebad09aa07c1af5caf5d1c794cf41ce1e3d9c5e676fd3a74d98d22b1e663d28"} Jun 09 02:19:56.763040 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.762974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"c11e5f9bcbf988bbf6cb1ac226fd418fab8fceaee55e17e44920d35bc9ba3105"} Jun 09 02:19:56.763040 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.763004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"7e6a7b19964fda0b82537f1c265d53330c8c243774f6c40287a85121edc25e02"} Jun 09 02:19:56.773121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.772984 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jbc56" podStartSLOduration=5.005734343 podStartE2EDuration="23.772968963s" totalImagesPullingTime="18.76723462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:56.772161267 +0000 UTC m=+23.640172137" watchObservedRunningTime="2026-06-09 02:19:56.772968963 +0000 UTC m=+23.640979835" Jun 09 02:19:56.932533 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:56.932504 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 02:19:57.627321 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.627206 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T02:19:56.93252859Z","UUID":"a79d08d4-fd6f-4a4d-b385-e1b08377b754","Handler":null,"Name":"","Endpoint":""} Jun 09 02:19:57.629275 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.629002 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 02:19:57.629275 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.629045 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 02:19:57.632374 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.631924 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:57.632374 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:57.632037 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:57.633155 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.632520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:57.633155 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:57.632600 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:19:57.767827 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:57.767546 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" event={"ID":"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b","Type":"ContainerStarted","Data":"17af29a013cd6a520f726f72f4ba3dcbc9ab543074c7c40cb99a84bd60562650"} Jun 09 02:19:58.631057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:58.631024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:19:58.631235 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:58.631141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:19:58.771873 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:58.771842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" event={"ID":"e0b02a95-2bcf-43c5-b07c-bce0b24ae19b","Type":"ContainerStarted","Data":"1c1355974c2b777bba8f493e5a72799ea55ac19a2c03608f50c00644ddffb5ba"} Jun 09 02:19:58.775179 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:58.775157 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:19:58.775609 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:58.775530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"2e1bdb97f83b56410547a32455a96ab73fb90f91d57c22b1d96258ac11e88da5"} Jun 09 02:19:58.789047 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:58.789002 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdt65" podStartSLOduration=4.952313747 podStartE2EDuration="25.788987429s" totalImagesPullingTime="20.836673682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:58.787855022 +0000 UTC m=+25.655865891" watchObservedRunningTime="2026-06-09 02:19:58.788987429 +0000 UTC m=+25.656998296" Jun 09 02:19:59.186701 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:59.186646 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:59.187424 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:59.187402 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:19:59.631198 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:59.631157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:19:59.631198 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:19:59.631194 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:19:59.631433 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:59.631296 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:19:59.631487 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:19:59.631428 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:00.631248 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.631000 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:00.631714 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:00.631251 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:20:00.781746 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.781710 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="be8b94148eadafaed0d5055f71f7b38b273359af12ebc6593ebf7d9ec4b2d31b" exitCode=0 Jun 09 02:20:00.781905 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.781817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"be8b94148eadafaed0d5055f71f7b38b273359af12ebc6593ebf7d9ec4b2d31b"} Jun 09 02:20:00.785549 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.785531 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:20:00.785914 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.785892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"03e59704695a5d4a019a451e8ccbfb790fed4b8cc06e5f9b701a6e36b4b62fc3"} Jun 09 02:20:00.786162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.786146 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:00.786254 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.786239 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:00.786325 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.786312 2565 scope.go:117] "RemoveContainer" containerID="75067f1a96dc53ea6909c1b9c08257b6a9a8fec940ce2edda7a00548d2887faf" Jun 09 02:20:00.803510 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:00.803483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:01.634541 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.634288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:01.634994 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:01.634645 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:20:01.635088 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.635067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:01.635193 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:01.635172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:01.791843 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.791757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:20:01.792192 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.792170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" event={"ID":"f7f518ba-c1f1-4714-ba72-40422d175ba6","Type":"ContainerStarted","Data":"6024b6ecd842017a73b6dc7094015e6d39d010a4ea849d60d5206c6570f10e36"} Jun 09 02:20:01.792464 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.792446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:01.795226 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.795197 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="3588692221bbf851596344659236d18244e0b326c190c9ee586c82570f988f1a" exitCode=0 Jun 09 02:20:01.795330 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.795240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"3588692221bbf851596344659236d18244e0b326c190c9ee586c82570f988f1a"} Jun 09 02:20:01.808128 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.808106 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:01.817564 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.817519 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" podStartSLOduration=8.989773236 podStartE2EDuration="27.817506263s" totalImagesPullingTime="18.827733027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:01.817051131 +0000 UTC m=+28.685062003" watchObservedRunningTime="2026-06-09 02:20:01.817506263 +0000 UTC m=+28.685517175" Jun 09 02:20:01.971121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.971091 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:20:01.971277 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.971211 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 02:20:01.971784 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:01.971759 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vk9kz" Jun 09 02:20:02.269290 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.269240 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g59z2"] Jun 09 02:20:02.269506 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.269376 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:02.269506 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:02.269475 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:20:02.269836 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.269798 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87sz6"] Jun 09 02:20:02.269922 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.269885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:02.269968 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:02.269952 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:20:02.271398 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.271381 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cdmms"] Jun 09 02:20:02.271476 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.271451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:02.271548 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:02.271528 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:02.800263 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.800231 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="cd53b62d692fecf55939e8016d20229345c7b2c74d4549639c0de2426b548487" exitCode=0 Jun 09 02:20:02.800827 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:02.800308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"cd53b62d692fecf55939e8016d20229345c7b2c74d4549639c0de2426b548487"} Jun 09 02:20:03.632107 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:03.632070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:03.632270 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:03.632182 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:20:03.632270 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:03.632210 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:03.632346 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:03.632319 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:20:03.632382 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:03.632350 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:03.632472 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:03.632438 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:05.631573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:05.631539 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:05.632331 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:05.631657 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:05.632331 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:05.631669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:20:05.632331 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:05.631795 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:05.632331 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:05.631898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:05.632331 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:05.631994 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:20:07.306497 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.306459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:07.306922 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.306603 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:20:07.306922 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.306619 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:20:07.306922 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.306629 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2ckzg for pod openshift-network-diagnostics/network-check-target-87sz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:07.306922 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.306689 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg podName:2d2a7149-32b8-4ad6-b44c-81750b085982 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:39.306674581 +0000 UTC m=+66.174685449 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ckzg" (UniqueName: "kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg") pod "network-check-target-87sz6" (UID: "2d2a7149-32b8-4ad6-b44c-81750b085982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:07.407273 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.407069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:07.407441 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.407289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:07.407441 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.407228 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:07.407441 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.407390 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:07.407441 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.407398 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:39.407383013 +0000 UTC m=+66.275393866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:07.407441 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.407429 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret podName:4b858869-7a1b-4979-bbee-fdcf55692c2d nodeName:}" failed. No retries permitted until 2026-06-09 02:20:39.407417761 +0000 UTC m=+66.275428610 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret") pod "global-pull-secret-syncer-g59z2" (UID: "4b858869-7a1b-4979-bbee-fdcf55692c2d") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:07.631667 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.631588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:07.631667 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.631634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:07.631936 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.631588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:07.631936 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.631714 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g59z2" podUID="4b858869-7a1b-4979-bbee-fdcf55692c2d" Jun 09 02:20:07.631936 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.631837 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87sz6" podUID="2d2a7149-32b8-4ad6-b44c-81750b085982" Jun 09 02:20:07.631936 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:07.631889 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:20:07.815352 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:07.815324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerStarted","Data":"59061ccd5c29bf38251f193440ea24adbafcdb82d5332045cdb0d3c5765af38d"} Jun 09 02:20:08.388724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.388692 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-232.ec2.internal" event="NodeReady" Jun 09 02:20:08.389172 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.388829 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 02:20:08.417942 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.417906 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw"] Jun 09 02:20:08.443409 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.443380 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv"] Jun 09 02:20:08.443547 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.443501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.446358 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.446333 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 02:20:08.446504 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.446366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vttm2\"" Jun 09 02:20:08.446504 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.446375 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 02:20:08.446504 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.446377 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 02:20:08.446504 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.446338 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 02:20:08.459473 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.459450 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22"] Jun 09 02:20:08.459624 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.459558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.461951 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.461927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 02:20:08.477416 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.477394 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:20:08.477540 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.477515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.480121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.480099 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 02:20:08.480249 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.480127 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 02:20:08.480249 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.480144 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 02:20:08.480249 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.480157 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 02:20:08.499547 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.499517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw"] Jun 09 02:20:08.499547 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.499547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv"] Jun 09 02:20:08.499735 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.499571 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xjfz5"] Jun 09 02:20:08.499735 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.499641 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.502235 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.502215 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 02:20:08.502235 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.502227 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 02:20:08.502456 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.502442 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 02:20:08.503767 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.503752 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mhf5x\"" Jun 09 02:20:08.508520 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.508190 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 02:20:08.514488 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.514467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lntqm\" (UniqueName: \"kubernetes.io/projected/d2f59d64-5929-4334-9c38-827b71044be8-kube-api-access-lntqm\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.514574 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.514517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f59d64-5929-4334-9c38-827b71044be8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.519765 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.519740 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9crsx"] Jun 09 02:20:08.519898 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.519880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.522348 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.522326 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 02:20:08.522348 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.522339 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\"" Jun 09 02:20:08.522467 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.522333 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 02:20:08.535716 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.535693 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:20:08.535845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.535728 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22"] Jun 09 02:20:08.535845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.535747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9crsx"] Jun 09 02:20:08.535845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.535768 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjfz5"] Jun 09 02:20:08.535845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.535829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.538208 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.538190 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 02:20:08.538320 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.538215 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 02:20:08.538320 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.538196 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dvgs\"" Jun 09 02:20:08.538320 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.538196 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 02:20:08.615023 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.614981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxr6s\" (UniqueName: \"kubernetes.io/projected/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-kube-api-access-dxr6s\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lntqm\" (UniqueName: \"kubernetes.io/projected/d2f59d64-5929-4334-9c38-827b71044be8-kube-api-access-lntqm\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615221 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adb62621-2b85-40af-8d49-89a2ef736ef5-config-volume\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhq4\" (UniqueName: \"kubernetes.io/projected/adb62621-2b85-40af-8d49-89a2ef736ef5-kube-api-access-ldhq4\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-cert\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5q67\" (UniqueName: \"kubernetes.io/projected/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-kube-api-access-d5q67\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56ba54aa-78fb-426e-9f26-34c53cab0a47-klusterlet-config\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f59d64-5929-4334-9c38-827b71044be8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ba54aa-78fb-426e-9f26-34c53cab0a47-tmp\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adb62621-2b85-40af-8d49-89a2ef736ef5-tmp-dir\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.615724 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.616005 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsc5c\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.616005 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.615772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8nf\" (UniqueName: \"kubernetes.io/projected/56ba54aa-78fb-426e-9f26-34c53cab0a47-kube-api-access-9g8nf\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.620128 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.620105 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f59d64-5929-4334-9c38-827b71044be8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.623959 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.623936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lntqm\" (UniqueName: \"kubernetes.io/projected/d2f59d64-5929-4334-9c38-827b71044be8-kube-api-access-lntqm\") pod \"managed-serviceaccount-addon-agent-76c4b9785b-dtmmw\" (UID: \"d2f59d64-5929-4334-9c38-827b71044be8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.716284 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.716481 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.716481 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56ba54aa-78fb-426e-9f26-34c53cab0a47-klusterlet-config\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.716481 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.716481 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ba54aa-78fb-426e-9f26-34c53cab0a47-tmp\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adb62621-2b85-40af-8d49-89a2ef736ef5-tmp-dir\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.716685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsc5c\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8nf\" (UniqueName: \"kubernetes.io/projected/56ba54aa-78fb-426e-9f26-34c53cab0a47-kube-api-access-9g8nf\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr6s\" (UniqueName: \"kubernetes.io/projected/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-kube-api-access-dxr6s\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adb62621-2b85-40af-8d49-89a2ef736ef5-config-volume\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.716969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhq4\" (UniqueName: \"kubernetes.io/projected/adb62621-2b85-40af-8d49-89a2ef736ef5-kube-api-access-ldhq4\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-cert\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q67\" (UniqueName: \"kubernetes.io/projected/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-kube-api-access-d5q67\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.717057 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.717819 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:08.717504 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:08.717819 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:08.717564 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:09.217544937 +0000 UTC m=+36.085555786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:08.717819 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ba54aa-78fb-426e-9f26-34c53cab0a47-tmp\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.717970 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:08.717836 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:08.717970 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:08.717852 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:08.717970 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:08.717895 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:09.217880771 +0000 UTC m=+36.085891637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:08.718115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.717968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adb62621-2b85-40af-8d49-89a2ef736ef5-tmp-dir\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.718115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.718005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.719086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.718782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adb62621-2b85-40af-8d49-89a2ef736ef5-config-volume\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.719460 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.719431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.719704 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.719678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56ba54aa-78fb-426e-9f26-34c53cab0a47-klusterlet-config\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.719782 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.719765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.720515 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.720485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-cert\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.720615 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.720600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.720704 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.720686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.720754 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.720709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-hub\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.720862 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.720842 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-ca\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.721454 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.721434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.724345 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.724291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.725726 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.725696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhq4\" (UniqueName: \"kubernetes.io/projected/adb62621-2b85-40af-8d49-89a2ef736ef5-kube-api-access-ldhq4\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:08.725855 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.725781 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8nf\" (UniqueName: \"kubernetes.io/projected/56ba54aa-78fb-426e-9f26-34c53cab0a47-kube-api-access-9g8nf\") pod \"klusterlet-addon-workmgr-69db54549d-zcmqv\" (UID: \"56ba54aa-78fb-426e-9f26-34c53cab0a47\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.726138 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.726118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5q67\" (UniqueName: \"kubernetes.io/projected/488047d2-5a92-4fe2-9ac7-a954cbfe88d1-kube-api-access-d5q67\") pod \"ingress-canary-9crsx\" (UID: \"488047d2-5a92-4fe2-9ac7-a954cbfe88d1\") " pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.726794 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.726770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr6s\" (UniqueName: \"kubernetes.io/projected/547d51b5-01e3-4f58-a1c9-7cff2b3c695a-kube-api-access-dxr6s\") pod \"cluster-proxy-proxy-agent-78774878b9-wpc22\" (UID: \"547d51b5-01e3-4f58-a1c9-7cff2b3c695a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.727179 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.727163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsc5c\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:08.765213 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.765172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:20:08.771276 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.771245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:08.784915 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.784893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:20:08.820618 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.820587 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="59061ccd5c29bf38251f193440ea24adbafcdb82d5332045cdb0d3c5765af38d" exitCode=0 Jun 09 02:20:08.820762 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.820633 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"59061ccd5c29bf38251f193440ea24adbafcdb82d5332045cdb0d3c5765af38d"} Jun 09 02:20:08.843148 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.843123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9crsx" Jun 09 02:20:08.990108 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:08.987365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw"] Jun 09 02:20:09.001602 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.001523 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv"] Jun 09 02:20:09.004902 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:20:09.004881 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ba54aa_78fb_426e_9f26_34c53cab0a47.slice/crio-01ae8d0cac7ad0c7b13b6697dbce896c61439fa5881e2327492968edf1df690f WatchSource:0}: Error finding container 01ae8d0cac7ad0c7b13b6697dbce896c61439fa5881e2327492968edf1df690f: Status 404 returned error can't find the container with id 01ae8d0cac7ad0c7b13b6697dbce896c61439fa5881e2327492968edf1df690f Jun 09 02:20:09.044845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.044580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22"] Jun 09 02:20:09.068099 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.068069 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9crsx"] Jun 09 02:20:09.090856 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:20:09.090824 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod547d51b5_01e3_4f58_a1c9_7cff2b3c695a.slice/crio-9d49f51276290841125d0a286d17eb4d32f7a1dad2891a2140757fc291ba78fd WatchSource:0}: Error finding container 9d49f51276290841125d0a286d17eb4d32f7a1dad2891a2140757fc291ba78fd: Status 404 returned error can't find the container with id 9d49f51276290841125d0a286d17eb4d32f7a1dad2891a2140757fc291ba78fd Jun 09 02:20:09.102559 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:20:09.102537 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488047d2_5a92_4fe2_9ac7_a954cbfe88d1.slice/crio-9e95d6abbafd59c2f2fa189e1ac59b666c77652ddb454f527734b8392cb778aa WatchSource:0}: Error finding container 9e95d6abbafd59c2f2fa189e1ac59b666c77652ddb454f527734b8392cb778aa: Status 404 returned error can't find the container with id 9e95d6abbafd59c2f2fa189e1ac59b666c77652ddb454f527734b8392cb778aa Jun 09 02:20:09.222608 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.222510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:09.222608 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.222566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:09.222840 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:09.222668 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:09.222840 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:09.222686 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:09.222840 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:09.222696 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:09.222840 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:09.222736 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:10.222718979 +0000 UTC m=+37.090729829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:09.222840 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:09.222749 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:10.222743676 +0000 UTC m=+37.090754525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:09.630872 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.630766 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:09.630872 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.630836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:09.630872 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.630780 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:09.633822 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.633787 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:20:09.633973 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.633841 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:20:09.633973 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.633861 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:20:09.633973 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.633903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:20:09.633973 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.633926 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\"" Jun 09 02:20:09.634237 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.634190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\"" Jun 09 02:20:09.824842 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.824789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerStarted","Data":"9d49f51276290841125d0a286d17eb4d32f7a1dad2891a2140757fc291ba78fd"} Jun 09 02:20:09.826094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.826069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerStarted","Data":"01ae8d0cac7ad0c7b13b6697dbce896c61439fa5881e2327492968edf1df690f"} Jun 09 02:20:09.827313 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.827282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerStarted","Data":"9f57d658468e3312ece2607f5c5ae799ff87e755eacdd15669dd01aee131b592"} Jun 09 02:20:09.830456 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.830430 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5c23a7-4eae-4ba0-904d-e875493a6c1e" containerID="127014c89ee2eb94542d77e1f74f7ea1ea1d5fc032ede4bf37a694d52240d711" exitCode=0 Jun 09 02:20:09.830550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.830508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerDied","Data":"127014c89ee2eb94542d77e1f74f7ea1ea1d5fc032ede4bf37a694d52240d711"} Jun 09 02:20:09.831965 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:09.831939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9crsx" event={"ID":"488047d2-5a92-4fe2-9ac7-a954cbfe88d1","Type":"ContainerStarted","Data":"9e95d6abbafd59c2f2fa189e1ac59b666c77652ddb454f527734b8392cb778aa"} Jun 09 02:20:10.230698 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:10.230661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:10.230901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:10.230726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:10.230901 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:10.230892 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:10.231025 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:10.230908 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:10.231025 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:10.230965 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:12.230947071 +0000 UTC m=+39.098957933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:10.231419 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:10.231396 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:10.231536 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:10.231453 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:12.231438089 +0000 UTC m=+39.099448940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:10.841533 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:10.841500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbps4" event={"ID":"5a5c23a7-4eae-4ba0-904d-e875493a6c1e","Type":"ContainerStarted","Data":"cbd83a385d683857b1b21bf97ad57b05b91a3ef83b7aba2fb0ef049b32e55f44"} Jun 09 02:20:10.863477 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:10.863408 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vbps4" podStartSLOduration=7.155191162 podStartE2EDuration="36.863384109s" totalImagesPullingTime="29.708192947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:10.861443428 +0000 UTC m=+37.729454315" watchObservedRunningTime="2026-06-09 02:20:10.863384109 +0000 UTC m=+37.731394982" Jun 09 02:20:12.247121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:12.247078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:12.247131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:12.247224 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:12.247238 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:12.247237 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:12.247299 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:16.247283179 +0000 UTC m=+43.115294028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:12.247495 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:12.247314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:16.247308473 +0000 UTC m=+43.115319322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:14.855238 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:14.854982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9crsx" event={"ID":"488047d2-5a92-4fe2-9ac7-a954cbfe88d1","Type":"ContainerStarted","Data":"d34bf5093596741d031dcaca36285bbb68411411da53ea3368ac21d432559995"} Jun 09 02:20:14.856850 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:14.856824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerStarted","Data":"4295c4dffe52f288c3cdea25a6ca61cb16637fa5b3b40ee1742a653f5cbf1d3a"} Jun 09 02:20:14.870782 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:14.870724 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9crsx" podStartSLOduration=2.01653798 podStartE2EDuration="6.870704425s" totalImagesPullingTime="4.854166445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:14.869644239 +0000 UTC m=+41.737655134" watchObservedRunningTime="2026-06-09 02:20:14.870704425 +0000 UTC m=+41.738715300" Jun 09 02:20:14.883629 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:14.883579 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" podStartSLOduration=27.925629626 podStartE2EDuration="32.883558873s" totalImagesPullingTime="4.957929247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:14.883015079 +0000 UTC m=+41.751025952" watchObservedRunningTime="2026-06-09 02:20:14.883558873 +0000 UTC m=+41.751569743" Jun 09 02:20:16.279314 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.279270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.279325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:16.279433 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:16.279434 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:16.279502 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:24.27948573 +0000 UTC m=+51.147496584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:16.279444 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:16.279727 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:16.279562 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:24.279551715 +0000 UTC m=+51.147562595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:16.863473 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.863434 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerStarted","Data":"9d79cc462d7072ac2fc5fb0b308716ea877fd6c39de1374946de231f534b1371"} Jun 09 02:20:16.863758 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.863736 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:16.865422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.865395 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:20:16.878367 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:16.878323 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" podStartSLOduration=28.023062591 podStartE2EDuration="34.878304889s" totalImagesPullingTime="6.855242298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:16.877673434 +0000 UTC m=+43.745684329" watchObservedRunningTime="2026-06-09 02:20:16.878304889 +0000 UTC m=+43.746315762" Jun 09 02:20:24.341825 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:24.341771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:24.342324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:24.341843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:24.342324 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:24.341950 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:24.342324 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:24.341966 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:24.342324 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:24.341976 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:24.342552 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:24.342388 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:40.342009896 +0000 UTC m=+67.210020746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:24.342552 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:24.342432 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:40.342411472 +0000 UTC m=+67.210422324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:26.890255 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:26.890216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerStarted","Data":"3527bc95a857fadeac22aeea2c2305662480c01feebeedd4d9dca0ca49afd932"} Jun 09 02:20:26.890665 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:26.890264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerStarted","Data":"8404c33dce1cdeb512da7441d06dc95235d542976266c7d2d98825b7749519e9"} Jun 09 02:20:26.890665 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:26.890276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerStarted","Data":"c1c2b4237de6c8fce83e1d42020219d8ff9a08442a6ed65524c7aa082f28ae9c"} Jun 09 02:20:26.907378 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:26.907325 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" podStartSLOduration=27.826741143 podStartE2EDuration="44.907309619s" totalImagesPullingTime="17.080568476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:26.905889705 +0000 UTC m=+53.773900574" watchObservedRunningTime="2026-06-09 02:20:26.907309619 +0000 UTC m=+53.775320490" Jun 09 02:20:33.813320 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:33.813287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qgk7" Jun 09 02:20:39.350555 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.350508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:39.353215 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.353197 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:20:39.364095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.364077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:20:39.376007 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.375974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ckzg\" (UniqueName: \"kubernetes.io/projected/2d2a7149-32b8-4ad6-b44c-81750b085982-kube-api-access-2ckzg\") pod \"network-check-target-87sz6\" (UID: \"2d2a7149-32b8-4ad6-b44c-81750b085982\") " pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:39.451155 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.451118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:39.451325 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.451188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:20:39.453726 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.453706 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:20:39.453771 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.453708 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:20:39.461786 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:39.461763 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:20:39.461885 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:39.461844 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:43.461823759 +0000 UTC m=+130.329834625 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : secret "metrics-daemon-secret" not found Jun 09 02:20:39.463943 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.463923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b858869-7a1b-4979-bbee-fdcf55692c2d-original-pull-secret\") pod \"global-pull-secret-syncer-g59z2\" (UID: \"4b858869-7a1b-4979-bbee-fdcf55692c2d\") " pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:39.643050 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.642973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g59z2" Jun 09 02:20:39.652094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.652068 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\"" Jun 09 02:20:39.658791 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.658715 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:39.770469 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.770432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g59z2"] Jun 09 02:20:39.773471 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:20:39.773442 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b858869_7a1b_4979_bbee_fdcf55692c2d.slice/crio-c9b14999df2129304ba11a4410a9e9afed4c9b952273c5b5ac8bb738fb38f90c WatchSource:0}: Error finding container c9b14999df2129304ba11a4410a9e9afed4c9b952273c5b5ac8bb738fb38f90c: Status 404 returned error can't find the container with id c9b14999df2129304ba11a4410a9e9afed4c9b952273c5b5ac8bb738fb38f90c Jun 09 02:20:39.787505 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.787481 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87sz6"] Jun 09 02:20:39.790185 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:20:39.790162 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2a7149_32b8_4ad6_b44c_81750b085982.slice/crio-ab76a14ff36cc04f32884588f62fecec99fc58f388f3288d7a6e29e2e3e826b8 WatchSource:0}: Error finding container ab76a14ff36cc04f32884588f62fecec99fc58f388f3288d7a6e29e2e3e826b8: Status 404 returned error can't find the container with id ab76a14ff36cc04f32884588f62fecec99fc58f388f3288d7a6e29e2e3e826b8 Jun 09 02:20:39.930934 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.930839 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87sz6" event={"ID":"2d2a7149-32b8-4ad6-b44c-81750b085982","Type":"ContainerStarted","Data":"ab76a14ff36cc04f32884588f62fecec99fc58f388f3288d7a6e29e2e3e826b8"} Jun 09 02:20:39.931938 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:39.931911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g59z2" event={"ID":"4b858869-7a1b-4979-bbee-fdcf55692c2d","Type":"ContainerStarted","Data":"c9b14999df2129304ba11a4410a9e9afed4c9b952273c5b5ac8bb738fb38f90c"} Jun 09 02:20:40.359291 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:40.359255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:40.359307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:40.359439 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:40.359458 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:40.359473 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:40.359518 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:12.359495694 +0000 UTC m=+99.227506559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:20:40.359857 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:20:40.359538 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:12.359528855 +0000 UTC m=+99.227539706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:20:42.943432 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:42.943394 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87sz6" event={"ID":"2d2a7149-32b8-4ad6-b44c-81750b085982","Type":"ContainerStarted","Data":"fc855aed71e2ebf6ef5b55ba0194b43734f69b5fc7f5ffec1cc21f705fc08503"} Jun 09 02:20:42.943888 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:42.943467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:20:42.959187 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:42.959133 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87sz6" podStartSLOduration=67.135244619 podStartE2EDuration="1m9.959113101s" totalImagesPullingTime="2.823868482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:42.957717314 +0000 UTC m=+69.825728182" watchObservedRunningTime="2026-06-09 02:20:42.959113101 +0000 UTC m=+69.827123966" Jun 09 02:20:44.951879 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:44.951844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g59z2" event={"ID":"4b858869-7a1b-4979-bbee-fdcf55692c2d","Type":"ContainerStarted","Data":"7b01f4691c0bbf1164e06553d07e243c492cbac255fc008cc46997d716deaf91"} Jun 09 02:20:44.968286 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:20:44.968231 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g59z2" podStartSLOduration=66.103912045 podStartE2EDuration="1m10.968214274s" totalImagesPullingTime="4.864302229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:44.967509734 +0000 UTC m=+71.835520617" watchObservedRunningTime="2026-06-09 02:20:44.968214274 +0000 UTC m=+71.836225144" Jun 09 02:21:12.403086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:21:12.403042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:21:12.403096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:12.403210 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:12.403225 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:12.403239 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:12.403297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:16.4032754 +0000 UTC m=+163.271286265 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:21:12.403512 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:12.403315 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:16.403304762 +0000 UTC m=+163.271315628 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:21:13.949709 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:21:13.949682 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87sz6" Jun 09 02:21:43.543666 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:21:43.543629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:21:43.544176 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:43.543751 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:21:43.544176 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:21:43.543820 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs podName:03529f88-6f83-4511-993e-0cfafdb127e5 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:45.543789677 +0000 UTC m=+252.411800527 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs") pod "network-metrics-daemon-cdmms" (UID: "03529f88-6f83-4511-993e-0cfafdb127e5") : secret "metrics-daemon-secret" not found Jun 09 02:22:11.528899 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:11.528855 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" Jun 09 02:22:11.532980 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:11.532954 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjfz5" podUID="adb62621-2b85-40af-8d49-89a2ef736ef5" Jun 09 02:22:12.198711 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:12.198678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:22:12.198890 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:12.198678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:22:12.652754 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:12.652651 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cdmms" podUID="03529f88-6f83-4511-993e-0cfafdb127e5" Jun 09 02:22:14.205535 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:14.205505 2565 generic.go:356] "Generic (PLEG): container finished" podID="d2f59d64-5929-4334-9c38-827b71044be8" containerID="4295c4dffe52f288c3cdea25a6ca61cb16637fa5b3b40ee1742a653f5cbf1d3a" exitCode=255 Jun 09 02:22:14.205897 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:14.205541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerDied","Data":"4295c4dffe52f288c3cdea25a6ca61cb16637fa5b3b40ee1742a653f5cbf1d3a"} Jun 09 02:22:14.205897 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:14.205856 2565 scope.go:117] "RemoveContainer" containerID="4295c4dffe52f288c3cdea25a6ca61cb16637fa5b3b40ee1742a653f5cbf1d3a" Jun 09 02:22:15.210528 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:15.210445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerStarted","Data":"eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3"} Jun 09 02:22:16.214903 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.214870 2565 generic.go:356] "Generic (PLEG): container finished" podID="56ba54aa-78fb-426e-9f26-34c53cab0a47" containerID="9d79cc462d7072ac2fc5fb0b308716ea877fd6c39de1374946de231f534b1371" exitCode=1 Jun 09 02:22:16.215262 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.214937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerDied","Data":"9d79cc462d7072ac2fc5fb0b308716ea877fd6c39de1374946de231f534b1371"} Jun 09 02:22:16.215262 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.215222 2565 scope.go:117] "RemoveContainer" containerID="9d79cc462d7072ac2fc5fb0b308716ea877fd6c39de1374946de231f534b1371" Jun 09 02:22:16.494045 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.494009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.494101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:16.494157 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:16.494176 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f7dccbf45-hlkkv: secret "image-registry-tls" not found Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:16.494193 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:16.494230 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls podName:e7de7dba-7c67-42cb-84d6-2b31b288a843 nodeName:}" failed. No retries permitted until 2026-06-09 02:24:18.494213496 +0000 UTC m=+285.362224345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls") pod "image-registry-6f7dccbf45-hlkkv" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843") : secret "image-registry-tls" not found Jun 09 02:22:16.494250 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:22:16.494243 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls podName:adb62621-2b85-40af-8d49-89a2ef736ef5 nodeName:}" failed. No retries permitted until 2026-06-09 02:24:18.494237128 +0000 UTC m=+285.362247977 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls") pod "dns-default-xjfz5" (UID: "adb62621-2b85-40af-8d49-89a2ef736ef5") : secret "dns-default-metrics-tls" not found Jun 09 02:22:16.864014 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:16.863933 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:22:17.219775 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:17.219733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerStarted","Data":"f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a"} Jun 09 02:22:17.220284 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:17.219931 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:22:17.220527 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:17.220506 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:22:24.631321 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:24.631279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:22:54.057699 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:54.057668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkxtz_a9294c4c-5b86-47ad-93be-d948e2111f37/dns-node-resolver/0.log" Jun 09 02:22:55.057567 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:55.057536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpnbh_cc8b9176-454b-4507-8d60-a49a1356b2d7/node-ca/0.log" Jun 09 02:22:55.657668 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:22:55.657640 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9crsx_488047d2-5a92-4fe2-9ac7-a954cbfe88d1/serve-healthcheck-canary/0.log" Jun 09 02:23:16.738938 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.738903 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vgjsj"] Jun 09 02:23:16.742213 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.742189 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.744947 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.744927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 02:23:16.745890 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.745874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 02:23:16.746156 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.746130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 02:23:16.746261 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.746170 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 02:23:16.746261 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.746211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzznw\"" Jun 09 02:23:16.757197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.757149 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgjsj"] Jun 09 02:23:16.843039 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.843008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e09fb3c-ac1d-416a-866f-020f203a6d78-data-volume\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.843039 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.843041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.843283 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.843060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e09fb3c-ac1d-416a-866f-020f203a6d78-crio-socket\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.843283 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.843078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e09fb3c-ac1d-416a-866f-020f203a6d78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.843283 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.843218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9vg\" (UniqueName: \"kubernetes.io/projected/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-api-access-2s9vg\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944393 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9vg\" (UniqueName: \"kubernetes.io/projected/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-api-access-2s9vg\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e09fb3c-ac1d-416a-866f-020f203a6d78-data-volume\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e09fb3c-ac1d-416a-866f-020f203a6d78-crio-socket\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e09fb3c-ac1d-416a-866f-020f203a6d78-crio-socket\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944692 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e09fb3c-ac1d-416a-866f-020f203a6d78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.944795 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.944779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e09fb3c-ac1d-416a-866f-020f203a6d78-data-volume\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.945126 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.945102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.947086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.947067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e09fb3c-ac1d-416a-866f-020f203a6d78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:16.955589 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:16.955572 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9vg\" (UniqueName: \"kubernetes.io/projected/0e09fb3c-ac1d-416a-866f-020f203a6d78-kube-api-access-2s9vg\") pod \"insights-runtime-extractor-vgjsj\" (UID: \"0e09fb3c-ac1d-416a-866f-020f203a6d78\") " pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:17.051496 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:17.051424 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgjsj" Jun 09 02:23:17.170393 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:17.170364 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgjsj"] Jun 09 02:23:17.173217 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:23:17.173193 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e09fb3c_ac1d_416a_866f_020f203a6d78.slice/crio-f26e74af1693897fd14cffb08b44130fe8935fcca461598bf9e4d11a7d45bb01 WatchSource:0}: Error finding container f26e74af1693897fd14cffb08b44130fe8935fcca461598bf9e4d11a7d45bb01: Status 404 returned error can't find the container with id f26e74af1693897fd14cffb08b44130fe8935fcca461598bf9e4d11a7d45bb01 Jun 09 02:23:17.386519 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:17.386445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgjsj" event={"ID":"0e09fb3c-ac1d-416a-866f-020f203a6d78","Type":"ContainerStarted","Data":"1bdb5bb6c6e6966493061fb00d7afa7b9ba86ff65986bb5891144b723c4ce5b5"} Jun 09 02:23:17.386519 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:17.386498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgjsj" event={"ID":"0e09fb3c-ac1d-416a-866f-020f203a6d78","Type":"ContainerStarted","Data":"f26e74af1693897fd14cffb08b44130fe8935fcca461598bf9e4d11a7d45bb01"} Jun 09 02:23:18.390848 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:18.390794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgjsj" event={"ID":"0e09fb3c-ac1d-416a-866f-020f203a6d78","Type":"ContainerStarted","Data":"a1917e62825a3aeeca87cb9989e7e121204198e7b8d2a34380d71ba3b7df7008"} Jun 09 02:23:18.786772 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:18.786724 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" podUID="547d51b5-01e3-4f58-a1c9-7cff2b3c695a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:23:20.398985 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:20.398947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgjsj" event={"ID":"0e09fb3c-ac1d-416a-866f-020f203a6d78","Type":"ContainerStarted","Data":"c7e30f2676b546392cdc2f75c460daa0c9083d0f5556c3621ecd1a7a912a6765"} Jun 09 02:23:20.415006 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:20.414954 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vgjsj" podStartSLOduration=2.031039942 podStartE2EDuration="4.414938945s" totalImagesPullingTime="2.383899003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:20.413841633 +0000 UTC m=+227.281852504" watchObservedRunningTime="2026-06-09 02:23:20.414938945 +0000 UTC m=+227.282949816" Jun 09 02:23:28.786195 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:28.786152 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" podUID="547d51b5-01e3-4f58-a1c9-7cff2b3c695a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:23:37.453224 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.453195 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mrjzv"] Jun 09 02:23:37.456532 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.456515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.458988 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.458968 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 02:23:37.459122 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.459103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 02:23:37.459200 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.459179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bstpg\"" Jun 09 02:23:37.460207 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.460194 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 02:23:37.460270 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.460196 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 02:23:37.460377 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.460361 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 02:23:37.460424 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.460360 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 02:23:37.594736 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-metrics-client-ca\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.594736 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.594971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-textfile\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.594971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-root\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.594971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.594971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-sys\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.595111 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.594983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-wtmp\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.595111 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.595002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.595111 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.595021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbhf\" (UniqueName: \"kubernetes.io/projected/6e5619b9-84a6-4175-97bd-582ff0a96337-kube-api-access-cdbhf\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696139 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-sys\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-wtmp\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-sys\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-wtmp\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbhf\" (UniqueName: \"kubernetes.io/projected/6e5619b9-84a6-4175-97bd-582ff0a96337-kube-api-access-cdbhf\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-metrics-client-ca\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-textfile\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-root\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e5619b9-84a6-4175-97bd-582ff0a96337-root\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.696828 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:23:37.696581 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 02:23:37.696828 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:23:37.696667 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls podName:6e5619b9-84a6-4175-97bd-582ff0a96337 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:38.196650554 +0000 UTC m=+245.064661416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls") pod "node-exporter-mrjzv" (UID: "6e5619b9-84a6-4175-97bd-582ff0a96337") : secret "node-exporter-tls" not found Jun 09 02:23:37.696828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-textfile\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.697021 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.697021 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.696950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5619b9-84a6-4175-97bd-582ff0a96337-metrics-client-ca\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.698951 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.698932 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:37.704373 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:37.704319 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbhf\" (UniqueName: \"kubernetes.io/projected/6e5619b9-84a6-4175-97bd-582ff0a96337-kube-api-access-cdbhf\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:38.200793 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.200760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:38.203125 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.203095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e5619b9-84a6-4175-97bd-582ff0a96337-node-exporter-tls\") pod \"node-exporter-mrjzv\" (UID: \"6e5619b9-84a6-4175-97bd-582ff0a96337\") " pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:38.364756 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.364728 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrjzv" Jun 09 02:23:38.375987 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:23:38.375955 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5619b9_84a6_4175_97bd_582ff0a96337.slice/crio-4002a629631956923eb96dd3e2fc79a9d8e55e78c86ce5d6293dad9566bea2b6 WatchSource:0}: Error finding container 4002a629631956923eb96dd3e2fc79a9d8e55e78c86ce5d6293dad9566bea2b6: Status 404 returned error can't find the container with id 4002a629631956923eb96dd3e2fc79a9d8e55e78c86ce5d6293dad9566bea2b6 Jun 09 02:23:38.455498 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.455415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrjzv" event={"ID":"6e5619b9-84a6-4175-97bd-582ff0a96337","Type":"ContainerStarted","Data":"4002a629631956923eb96dd3e2fc79a9d8e55e78c86ce5d6293dad9566bea2b6"} Jun 09 02:23:38.786541 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.786447 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" podUID="547d51b5-01e3-4f58-a1c9-7cff2b3c695a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:23:38.786698 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.786540 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" Jun 09 02:23:38.787143 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.787108 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"3527bc95a857fadeac22aeea2c2305662480c01feebeedd4d9dca0ca49afd932"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 02:23:38.787232 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:38.787166 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" podUID="547d51b5-01e3-4f58-a1c9-7cff2b3c695a" containerName="service-proxy" containerID="cri-o://3527bc95a857fadeac22aeea2c2305662480c01feebeedd4d9dca0ca49afd932" gracePeriod=30 Jun 09 02:23:39.460080 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:39.460043 2565 generic.go:356] "Generic (PLEG): container finished" podID="6e5619b9-84a6-4175-97bd-582ff0a96337" containerID="a3846fd480b5ed046af026a894dc93d533818a5ac9376d0b9cd49a55bbfdd500" exitCode=0 Jun 09 02:23:39.460496 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:39.460128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrjzv" event={"ID":"6e5619b9-84a6-4175-97bd-582ff0a96337","Type":"ContainerDied","Data":"a3846fd480b5ed046af026a894dc93d533818a5ac9376d0b9cd49a55bbfdd500"} Jun 09 02:23:39.462456 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:39.462432 2565 generic.go:356] "Generic (PLEG): container finished" podID="547d51b5-01e3-4f58-a1c9-7cff2b3c695a" containerID="3527bc95a857fadeac22aeea2c2305662480c01feebeedd4d9dca0ca49afd932" exitCode=2 Jun 09 02:23:39.462456 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:39.462453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerDied","Data":"3527bc95a857fadeac22aeea2c2305662480c01feebeedd4d9dca0ca49afd932"} Jun 09 02:23:39.462600 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:39.462484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78774878b9-wpc22" event={"ID":"547d51b5-01e3-4f58-a1c9-7cff2b3c695a","Type":"ContainerStarted","Data":"0cc2eec852a3d1504459fc9020c25684e3b7927f067c054a6e254541c680ad92"} Jun 09 02:23:40.467040 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:40.467006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrjzv" event={"ID":"6e5619b9-84a6-4175-97bd-582ff0a96337","Type":"ContainerStarted","Data":"a35dccedc930261bde0a9c8558e716cb001d78b2f5fe7f33ceaef152d2830ff0"} Jun 09 02:23:40.467443 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:40.467056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrjzv" event={"ID":"6e5619b9-84a6-4175-97bd-582ff0a96337","Type":"ContainerStarted","Data":"bb22b61defb983cd9630c49e6e1b5f66b6fb77148e79e435d04a5088c4f5ef7b"} Jun 09 02:23:45.558514 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.558403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:23:45.560787 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.560762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03529f88-6f83-4511-993e-0cfafdb127e5-metrics-certs\") pod \"network-metrics-daemon-cdmms\" (UID: \"03529f88-6f83-4511-993e-0cfafdb127e5\") " pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:23:45.634988 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.634959 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\"" Jun 09 02:23:45.643042 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.643022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cdmms" Jun 09 02:23:45.765240 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.765190 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mrjzv" podStartSLOduration=7.830543014 podStartE2EDuration="8.7651721s" totalImagesPullingTime="863.727681ms" totalInitContainerRuntime="70.901405ms" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:40.484300571 +0000 UTC m=+247.352311441" watchObservedRunningTime="2026-06-09 02:23:45.7651721 +0000 UTC m=+252.633182970" Jun 09 02:23:45.765660 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:45.765576 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cdmms"] Jun 09 02:23:45.768242 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:23:45.768214 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03529f88_6f83_4511_993e_0cfafdb127e5.slice/crio-072fe00dcabcd84a4d8de1a4c8b4295416a40d9467149b28e31a99275b3ce77b WatchSource:0}: Error finding container 072fe00dcabcd84a4d8de1a4c8b4295416a40d9467149b28e31a99275b3ce77b: Status 404 returned error can't find the container with id 072fe00dcabcd84a4d8de1a4c8b4295416a40d9467149b28e31a99275b3ce77b Jun 09 02:23:46.486743 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:46.486706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cdmms" event={"ID":"03529f88-6f83-4511-993e-0cfafdb127e5","Type":"ContainerStarted","Data":"072fe00dcabcd84a4d8de1a4c8b4295416a40d9467149b28e31a99275b3ce77b"} Jun 09 02:23:47.491175 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:47.491138 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cdmms" event={"ID":"03529f88-6f83-4511-993e-0cfafdb127e5","Type":"ContainerStarted","Data":"e75bf6d888b5add65a7f17d3cd4f98a4e67c2ea82463e0c7f810107f43790e07"} Jun 09 02:23:47.491574 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:47.491199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cdmms" event={"ID":"03529f88-6f83-4511-993e-0cfafdb127e5","Type":"ContainerStarted","Data":"af4de4aa2adac378af7472db7b795b001606cb8384c0ecc147f021457bcc1092"} Jun 09 02:23:47.506088 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:23:47.506036 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cdmms" podStartSLOduration=252.533499954 podStartE2EDuration="4m13.5060181s" totalImagesPullingTime="972.518146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:47.505341427 +0000 UTC m=+254.373352298" watchObservedRunningTime="2026-06-09 02:23:47.5060181 +0000 UTC m=+254.374028971" Jun 09 02:24:14.573897 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:14.573864 2565 generic.go:356] "Generic (PLEG): container finished" podID="d2f59d64-5929-4334-9c38-827b71044be8" containerID="eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3" exitCode=255 Jun 09 02:24:14.574339 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:14.573940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerDied","Data":"eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3"} Jun 09 02:24:14.574339 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:14.573989 2565 scope.go:117] "RemoveContainer" containerID="4295c4dffe52f288c3cdea25a6ca61cb16637fa5b3b40ee1742a653f5cbf1d3a" Jun 09 02:24:14.574339 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:14.574247 2565 scope.go:117] "RemoveContainer" containerID="eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3" Jun 09 02:24:14.574506 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:14.574453 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76c4b9785b-dtmmw_open-cluster-management-agent-addon(d2f59d64-5929-4334-9c38-827b71044be8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" podUID="d2f59d64-5929-4334-9c38-827b71044be8" Jun 09 02:24:15.200162 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:15.200117 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" Jun 09 02:24:15.200162 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:15.200116 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjfz5" podUID="adb62621-2b85-40af-8d49-89a2ef736ef5" Jun 09 02:24:15.578443 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:15.578370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:15.578443 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:15.578399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:16.583253 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:16.583214 2565 generic.go:356] "Generic (PLEG): container finished" podID="56ba54aa-78fb-426e-9f26-34c53cab0a47" containerID="f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a" exitCode=1 Jun 09 02:24:16.583679 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:16.583268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerDied","Data":"f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a"} Jun 09 02:24:16.583679 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:16.583319 2565 scope.go:117] "RemoveContainer" containerID="9d79cc462d7072ac2fc5fb0b308716ea877fd6c39de1374946de231f534b1371" Jun 09 02:24:16.583679 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:16.583673 2565 scope.go:117] "RemoveContainer" containerID="f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a" Jun 09 02:24:16.583890 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:16.583869 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69db54549d-zcmqv_open-cluster-management-agent-addon(56ba54aa-78fb-426e-9f26-34c53cab0a47)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" podUID="56ba54aa-78fb-426e-9f26-34c53cab0a47" Jun 09 02:24:17.220473 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:17.220429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:24:17.587562 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:17.587476 2565 scope.go:117] "RemoveContainer" containerID="f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a" Jun 09 02:24:17.587918 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:17.587624 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69db54549d-zcmqv_open-cluster-management-agent-addon(56ba54aa-78fb-426e-9f26-34c53cab0a47)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" podUID="56ba54aa-78fb-426e-9f26-34c53cab0a47" Jun 09 02:24:18.511090 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.511057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:18.511262 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.511097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:18.513566 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.513536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adb62621-2b85-40af-8d49-89a2ef736ef5-metrics-tls\") pod \"dns-default-xjfz5\" (UID: \"adb62621-2b85-40af-8d49-89a2ef736ef5\") " pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:18.513677 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.513650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"image-registry-6f7dccbf45-hlkkv\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:18.582554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.582525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mhf5x\"" Jun 09 02:24:18.583480 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.583464 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\"" Jun 09 02:24:18.590188 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.590168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:18.590479 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.590277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:18.729149 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.729114 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:24:18.732472 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:24:18.732440 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7de7dba_7c67_42cb_84d6_2b31b288a843.slice/crio-0675a3e0c3ffa8a58106002ca77e42b2e0c27d58db3f7a5339d6e0686cfcd31f WatchSource:0}: Error finding container 0675a3e0c3ffa8a58106002ca77e42b2e0c27d58db3f7a5339d6e0686cfcd31f: Status 404 returned error can't find the container with id 0675a3e0c3ffa8a58106002ca77e42b2e0c27d58db3f7a5339d6e0686cfcd31f Jun 09 02:24:18.741793 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.741755 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjfz5"] Jun 09 02:24:18.745133 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:24:18.745107 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb62621_2b85_40af_8d49_89a2ef736ef5.slice/crio-7e11d129c1cb537fd7317973752519af749bd196e6f7cdaf958afa471e54b257 WatchSource:0}: Error finding container 7e11d129c1cb537fd7317973752519af749bd196e6f7cdaf958afa471e54b257: Status 404 returned error can't find the container with id 7e11d129c1cb537fd7317973752519af749bd196e6f7cdaf958afa471e54b257 Jun 09 02:24:18.765423 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.765398 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" Jun 09 02:24:18.765746 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.765729 2565 scope.go:117] "RemoveContainer" containerID="eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3" Jun 09 02:24:18.765945 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:18.765922 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76c4b9785b-dtmmw_open-cluster-management-agent-addon(d2f59d64-5929-4334-9c38-827b71044be8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" podUID="d2f59d64-5929-4334-9c38-827b71044be8" Jun 09 02:24:18.771539 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.771515 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:24:18.771889 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.771874 2565 scope.go:117] "RemoveContainer" containerID="f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a" Jun 09 02:24:18.772036 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:24:18.772019 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69db54549d-zcmqv_open-cluster-management-agent-addon(56ba54aa-78fb-426e-9f26-34c53cab0a47)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" podUID="56ba54aa-78fb-426e-9f26-34c53cab0a47" Jun 09 02:24:18.844494 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:18.844462 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/init-textfile/0.log" Jun 09 02:24:19.046358 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.046293 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/node-exporter/0.log" Jun 09 02:24:19.244573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.244544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/kube-rbac-proxy/0.log" Jun 09 02:24:19.593980 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.593941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjfz5" event={"ID":"adb62621-2b85-40af-8d49-89a2ef736ef5","Type":"ContainerStarted","Data":"7e11d129c1cb537fd7317973752519af749bd196e6f7cdaf958afa471e54b257"} Jun 09 02:24:19.595792 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.595766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" event={"ID":"e7de7dba-7c67-42cb-84d6-2b31b288a843","Type":"ContainerStarted","Data":"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4"} Jun 09 02:24:19.595943 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.595823 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" event={"ID":"e7de7dba-7c67-42cb-84d6-2b31b288a843","Type":"ContainerStarted","Data":"0675a3e0c3ffa8a58106002ca77e42b2e0c27d58db3f7a5339d6e0686cfcd31f"} Jun 09 02:24:19.595943 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.595918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:19.615985 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:19.615930 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podStartSLOduration=285.615911388 podStartE2EDuration="4m45.615911388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:24:19.614072964 +0000 UTC m=+286.482083846" watchObservedRunningTime="2026-06-09 02:24:19.615911388 +0000 UTC m=+286.483922260" Jun 09 02:24:21.604740 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:21.604705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjfz5" event={"ID":"adb62621-2b85-40af-8d49-89a2ef736ef5","Type":"ContainerStarted","Data":"1f17bbed1822d4da3f7644a840d29fdc48de6c056989274ac4d02887fcf67036"} Jun 09 02:24:21.605233 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:21.604755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjfz5" event={"ID":"adb62621-2b85-40af-8d49-89a2ef736ef5","Type":"ContainerStarted","Data":"ee2cfc1093b8d60f41263d30307be93b1e88f9f1699da9a9f1bb2da1ac20d8b9"} Jun 09 02:24:21.605233 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:21.604786 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:21.621188 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:21.621138 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xjfz5" podStartSLOduration=251.813101142 podStartE2EDuration="4m13.62111817s" totalImagesPullingTime="1.808017028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:24:21.620419564 +0000 UTC m=+288.488430435" watchObservedRunningTime="2026-06-09 02:24:21.62111817 +0000 UTC m=+288.489129041" Jun 09 02:24:26.245994 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:26.245953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjfz5_adb62621-2b85-40af-8d49-89a2ef736ef5/dns/0.log" Jun 09 02:24:26.445666 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:26.445638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjfz5_adb62621-2b85-40af-8d49-89a2ef736ef5/kube-rbac-proxy/0.log" Jun 09 02:24:27.045359 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:27.045330 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkxtz_a9294c4c-5b86-47ad-93be-d948e2111f37/dns-node-resolver/0.log" Jun 09 02:24:27.445626 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:27.445594 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f7dccbf45-hlkkv_e7de7dba-7c67-42cb-84d6-2b31b288a843/registry/0.log" Jun 09 02:24:28.045342 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:28.045317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpnbh_cc8b9176-454b-4507-8d60-a49a1356b2d7/node-ca/0.log" Jun 09 02:24:28.644396 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:28.644366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9crsx_488047d2-5a92-4fe2-9ac7-a954cbfe88d1/serve-healthcheck-canary/0.log" Jun 09 02:24:30.635645 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:30.631735 2565 scope.go:117] "RemoveContainer" containerID="eaa43b6c3cff374857ff4b95200de52198532e50c181d1714e104e5d4a5d94b3" Jun 09 02:24:30.636360 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:30.636340 2565 scope.go:117] "RemoveContainer" containerID="f9e18c9040d4dbe24cfaefb167b7859551e8281fbd3eebb572e3826ac618b45a" Jun 09 02:24:31.611033 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:31.610998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xjfz5" Jun 09 02:24:31.642941 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:31.642905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" event={"ID":"56ba54aa-78fb-426e-9f26-34c53cab0a47","Type":"ContainerStarted","Data":"e7f2dcf4fd8c924ffb47466c50886115c08f1cec78c3448b0c311be14d94c55a"} Jun 09 02:24:31.643374 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:31.643207 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:24:31.644597 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:31.644572 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69db54549d-zcmqv" Jun 09 02:24:31.644947 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:31.644931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76c4b9785b-dtmmw" event={"ID":"d2f59d64-5929-4334-9c38-827b71044be8","Type":"ContainerStarted","Data":"134aab978df648f4ddd733b9561d0f28ab39b0c82e9bc506a7f516d195981278"} Jun 09 02:24:33.561208 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:33.561178 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:24:33.562020 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:33.561998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:24:33.565387 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:33.565363 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 02:24:38.594982 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:38.594945 2565 patch_prober.go:28] interesting pod/image-registry-6f7dccbf45-hlkkv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:24:38.597358 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:38.595004 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:24:40.604759 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:40.604725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:24:45.437711 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:24:45.437678 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:25:10.456899 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.456837 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" containerID="cri-o://4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4" gracePeriod=30 Jun 09 02:25:10.600844 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.600793 2565 patch_prober.go:28] interesting pod/image-registry-6f7dccbf45-hlkkv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.9:5000/healthz\": dial tcp 10.132.0.9:5000: connect: connection refused" start-of-body= Jun 09 02:25:10.601033 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.600875 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.9:5000/healthz\": dial tcp 10.132.0.9:5000: connect: connection refused" Jun 09 02:25:10.700979 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.700957 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:25:10.769615 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.769523 2565 generic.go:356] "Generic (PLEG): container finished" podID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerID="4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4" exitCode=0 Jun 09 02:25:10.769615 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.769566 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" Jun 09 02:25:10.769615 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.769597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" event={"ID":"e7de7dba-7c67-42cb-84d6-2b31b288a843","Type":"ContainerDied","Data":"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4"} Jun 09 02:25:10.769901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.769646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f7dccbf45-hlkkv" event={"ID":"e7de7dba-7c67-42cb-84d6-2b31b288a843","Type":"ContainerDied","Data":"0675a3e0c3ffa8a58106002ca77e42b2e0c27d58db3f7a5339d6e0686cfcd31f"} Jun 09 02:25:10.769901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.769671 2565 scope.go:117] "RemoveContainer" containerID="4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4" Jun 09 02:25:10.777219 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777204 2565 scope.go:117] "RemoveContainer" containerID="4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4" Jun 09 02:25:10.777475 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:25:10.777459 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4\": container with ID starting with 4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4 not found: ID does not exist" containerID="4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4" Jun 09 02:25:10.777518 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777484 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4"} err="failed to get container status \"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4\": rpc error: code = NotFound desc = could not find container \"4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4\": container with ID starting with 4c5a98b907c9293cabe37ad0c16726f43042203aa4a94577f25f5e7f29bc44c4 not found: ID does not exist" Jun 09 02:25:10.777634 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777624 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777668 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777707 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777680 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsc5c\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777707 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777701 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777726 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777753 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777828 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777782 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.777968 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.777833 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates\") pod \"e7de7dba-7c67-42cb-84d6-2b31b288a843\" (UID: \"e7de7dba-7c67-42cb-84d6-2b31b288a843\") " Jun 09 02:25:10.778328 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.778276 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:10.778442 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.778344 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:10.780409 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.780370 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:25:10.780522 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.780439 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c" (OuterVolumeSpecName: "kube-api-access-vsc5c") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "kube-api-access-vsc5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:25:10.780579 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.780520 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:25:10.780620 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.780591 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:25:10.780748 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.780722 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:25:10.786466 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.786437 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7de7dba-7c67-42cb-84d6-2b31b288a843" (UID: "e7de7dba-7c67-42cb-84d6-2b31b288a843"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:25:10.878753 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878713 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-installation-pull-secrets\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.878753 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878745 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7de7dba-7c67-42cb-84d6-2b31b288a843-image-registry-private-configuration\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.878753 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878756 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsc5c\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-kube-api-access-vsc5c\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.878753 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878764 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-tls\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.879044 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878775 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7de7dba-7c67-42cb-84d6-2b31b288a843-bound-sa-token\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.879044 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878788 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-trusted-ca\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.879044 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878796 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7de7dba-7c67-42cb-84d6-2b31b288a843-ca-trust-extracted\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:10.879044 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:10.878825 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7de7dba-7c67-42cb-84d6-2b31b288a843-registry-certificates\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:25:11.089971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:11.089945 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:25:11.093491 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:11.093468 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f7dccbf45-hlkkv"] Jun 09 02:25:11.635592 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:25:11.635560 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" path="/var/lib/kubelet/pods/e7de7dba-7c67-42cb-84d6-2b31b288a843/volumes" Jun 09 02:26:27.264274 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.264241 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm"] Jun 09 02:26:27.264676 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.264480 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" Jun 09 02:26:27.264676 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.264490 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" Jun 09 02:26:27.264676 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.264540 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7de7dba-7c67-42cb-84d6-2b31b288a843" containerName="registry" Jun 09 02:26:27.267232 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.267216 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.269662 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.269633 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 02:26:27.269662 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.269633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qc4sf\"" Jun 09 02:26:27.270757 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.270724 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 02:26:27.274121 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.274096 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm"] Jun 09 02:26:27.295759 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.295723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcrl2\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-kube-api-access-tcrl2\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.295759 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.295762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.396603 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.396564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcrl2\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-kube-api-access-tcrl2\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.396603 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.396605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.405131 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.405094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.405131 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.405116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcrl2\" (UniqueName: \"kubernetes.io/projected/75fc12cf-169e-406f-9984-77ba70b64bc7-kube-api-access-tcrl2\") pod \"cert-manager-webhook-7dc76cbb94-rzbdm\" (UID: \"75fc12cf-169e-406f-9984-77ba70b64bc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.576024 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.575922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:27.704905 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:26:27.704870 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75fc12cf_169e_406f_9984_77ba70b64bc7.slice/crio-3e56f8d88d1101cac76be1be5413ea908c61dff74eedbd9e179e65f6fc0cfb98 WatchSource:0}: Error finding container 3e56f8d88d1101cac76be1be5413ea908c61dff74eedbd9e179e65f6fc0cfb98: Status 404 returned error can't find the container with id 3e56f8d88d1101cac76be1be5413ea908c61dff74eedbd9e179e65f6fc0cfb98 Jun 09 02:26:27.705055 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.705008 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm"] Jun 09 02:26:27.706785 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:27.706771 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:26:28.016113 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:28.016080 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" event={"ID":"75fc12cf-169e-406f-9984-77ba70b64bc7","Type":"ContainerStarted","Data":"3e56f8d88d1101cac76be1be5413ea908c61dff74eedbd9e179e65f6fc0cfb98"} Jun 09 02:26:31.028401 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:31.028361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" event={"ID":"75fc12cf-169e-406f-9984-77ba70b64bc7","Type":"ContainerStarted","Data":"62dfa7871f83fd73114e39fd51bda1a012478feb4822a291141136155217ce02"} Jun 09 02:26:31.028779 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:31.028487 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:31.044146 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:31.044047 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" podStartSLOduration=1.582390805 podStartE2EDuration="4.044028642s" totalImagesPullingTime="2.461637837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:31.043710188 +0000 UTC m=+417.911721072" watchObservedRunningTime="2026-06-09 02:26:31.044028642 +0000 UTC m=+417.912039513" Jun 09 02:26:37.033947 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:37.033916 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rzbdm" Jun 09 02:26:55.280919 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.280833 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk"] Jun 09 02:26:55.285153 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.285131 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.288129 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.288100 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzlcg\"" Jun 09 02:26:55.288129 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.288103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 02:26:55.288333 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.288167 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 02:26:55.288333 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.288103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 02:26:55.288333 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.288133 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 02:26:55.301742 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.301699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk"] Jun 09 02:26:55.392251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.392208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.392251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.392252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.392480 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.392273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.392480 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.392385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4nd\" (UniqueName: \"kubernetes.io/projected/7b222daa-96e0-4f31-a5e0-b00987a2738a-kube-api-access-5m4nd\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.392480 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.392427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493139 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493139 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493402 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493402 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493402 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4nd\" (UniqueName: \"kubernetes.io/projected/7b222daa-96e0-4f31-a5e0-b00987a2738a-kube-api-access-5m4nd\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.493581 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.493552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.495575 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.495548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b222daa-96e0-4f31-a5e0-b00987a2738a-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.495767 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.495746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.495903 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.495886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b222daa-96e0-4f31-a5e0-b00987a2738a-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.501417 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.501388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4nd\" (UniqueName: \"kubernetes.io/projected/7b222daa-96e0-4f31-a5e0-b00987a2738a-kube-api-access-5m4nd\") pod \"opendatahub-operator-controller-manager-777db45658-gtsnk\" (UID: \"7b222daa-96e0-4f31-a5e0-b00987a2738a\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.595639 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.595545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:26:55.732207 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:55.732180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk"] Jun 09 02:26:55.734887 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:26:55.734857 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b222daa_96e0_4f31_a5e0_b00987a2738a.slice/crio-d98c4e68f1a6f97443bbc75383936fe546193855f34c41f8bcd8c7f7272fc74e WatchSource:0}: Error finding container d98c4e68f1a6f97443bbc75383936fe546193855f34c41f8bcd8c7f7272fc74e: Status 404 returned error can't find the container with id d98c4e68f1a6f97443bbc75383936fe546193855f34c41f8bcd8c7f7272fc74e Jun 09 02:26:56.111729 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:56.111694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" event={"ID":"7b222daa-96e0-4f31-a5e0-b00987a2738a","Type":"ContainerStarted","Data":"d98c4e68f1a6f97443bbc75383936fe546193855f34c41f8bcd8c7f7272fc74e"} Jun 09 02:26:59.124420 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:26:59.124382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" event={"ID":"7b222daa-96e0-4f31-a5e0-b00987a2738a","Type":"ContainerStarted","Data":"2b6925827498324c08a791222ee55369f0a33a1965944351b51702934842cc91"} Jun 09 02:27:00.129162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:00.129125 2565 generic.go:356] "Generic (PLEG): container finished" podID="7b222daa-96e0-4f31-a5e0-b00987a2738a" containerID="2b6925827498324c08a791222ee55369f0a33a1965944351b51702934842cc91" exitCode=0 Jun 09 02:27:00.129589 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:00.129209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" event={"ID":"7b222daa-96e0-4f31-a5e0-b00987a2738a","Type":"ContainerDied","Data":"2b6925827498324c08a791222ee55369f0a33a1965944351b51702934842cc91"} Jun 09 02:27:01.134733 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:01.134699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" event={"ID":"7b222daa-96e0-4f31-a5e0-b00987a2738a","Type":"ContainerStarted","Data":"a29a851bbfe27e7a0c6818669ebb7a8036c2717bdd98e064170166a097cda086"} Jun 09 02:27:01.135168 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:01.134828 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:27:01.155927 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:01.155867 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" podStartSLOduration=2.040927977 podStartE2EDuration="6.1558496s" totalImagesPullingTime="3.192598479s" totalInitContainerRuntime="922.323144ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:01.154638295 +0000 UTC m=+448.022649179" watchObservedRunningTime="2026-06-09 02:27:01.1558496 +0000 UTC m=+448.023860472" Jun 09 02:27:11.835991 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.835952 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn"] Jun 09 02:27:11.843573 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.843546 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:11.847874 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.847850 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 02:27:11.847874 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.847874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 02:27:11.848056 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.847858 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7b7vh\"" Jun 09 02:27:11.848056 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.847858 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:27:11.848154 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.848139 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 02:27:11.848187 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.848160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 02:27:11.854094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.854074 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn"] Jun 09 02:27:11.910158 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.910122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-metrics-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:11.910345 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.910163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7745cff3-303d-414f-9ed4-f26abcaf0c5e-manager-config\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:11.910345 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.910189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:11.910345 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:11.910270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqqd\" (UniqueName: \"kubernetes.io/projected/7745cff3-303d-414f-9ed4-f26abcaf0c5e-kube-api-access-wjqqd\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.011656 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.011615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqqd\" (UniqueName: \"kubernetes.io/projected/7745cff3-303d-414f-9ed4-f26abcaf0c5e-kube-api-access-wjqqd\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.011886 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.011685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-metrics-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.011886 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.011709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7745cff3-303d-414f-9ed4-f26abcaf0c5e-manager-config\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.011886 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.011729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.012506 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.012438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7745cff3-303d-414f-9ed4-f26abcaf0c5e-manager-config\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.014451 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.014428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.014528 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.014428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7745cff3-303d-414f-9ed4-f26abcaf0c5e-metrics-cert\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.021655 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.021635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqqd\" (UniqueName: \"kubernetes.io/projected/7745cff3-303d-414f-9ed4-f26abcaf0c5e-kube-api-access-wjqqd\") pod \"lws-controller-manager-67785bd58c-b8xrn\" (UID: \"7745cff3-303d-414f-9ed4-f26abcaf0c5e\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.140701 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.140616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-gtsnk" Jun 09 02:27:12.152189 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.152160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:12.283713 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:12.283676 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn"] Jun 09 02:27:12.286479 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:27:12.286452 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7745cff3_303d_414f_9ed4_f26abcaf0c5e.slice/crio-2bcab1b3db5f01ff83d90b1e15f0c2446c41e56f07e6937f881e156e42c0c598 WatchSource:0}: Error finding container 2bcab1b3db5f01ff83d90b1e15f0c2446c41e56f07e6937f881e156e42c0c598: Status 404 returned error can't find the container with id 2bcab1b3db5f01ff83d90b1e15f0c2446c41e56f07e6937f881e156e42c0c598 Jun 09 02:27:13.177642 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:13.177603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" event={"ID":"7745cff3-303d-414f-9ed4-f26abcaf0c5e","Type":"ContainerStarted","Data":"2bcab1b3db5f01ff83d90b1e15f0c2446c41e56f07e6937f881e156e42c0c598"} Jun 09 02:27:14.125444 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.125408 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c"] Jun 09 02:27:14.133868 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.133843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.136254 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.136229 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 02:27:14.136394 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.136340 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 02:27:14.136394 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.136347 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vgnt2\"" Jun 09 02:27:14.137578 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.137557 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 02:27:14.137578 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.137572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 02:27:14.141062 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.141035 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c"] Jun 09 02:27:14.231642 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.231594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tmp\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.231642 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.231645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkh9\" (UniqueName: \"kubernetes.io/projected/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-kube-api-access-8pkh9\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.232130 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.231738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.332926 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.332890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkh9\" (UniqueName: \"kubernetes.io/projected/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-kube-api-access-8pkh9\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.333117 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.332960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.333117 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.333047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tmp\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.333117 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:27:14.333071 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 02:27:14.333314 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:27:14.333142 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs podName:54ddef67-18c2-4ca4-96bd-8a33a55c03a3 nodeName:}" failed. No retries permitted until 2026-06-09 02:27:14.833119863 +0000 UTC m=+461.701130719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs") pod "kube-auth-proxy-5687f7b7-hnh9c" (UID: "54ddef67-18c2-4ca4-96bd-8a33a55c03a3") : secret "kube-auth-proxy-tls" not found Jun 09 02:27:14.335560 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.335538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tmp\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.351762 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.351705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkh9\" (UniqueName: \"kubernetes.io/projected/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-kube-api-access-8pkh9\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.838144 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.838103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:14.840568 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:14.840548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ddef67-18c2-4ca4-96bd-8a33a55c03a3-tls-certs\") pod \"kube-auth-proxy-5687f7b7-hnh9c\" (UID: \"54ddef67-18c2-4ca4-96bd-8a33a55c03a3\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:15.046524 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.046483 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" Jun 09 02:27:15.171376 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.171350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c"] Jun 09 02:27:15.173774 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:27:15.173732 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ddef67_18c2_4ca4_96bd_8a33a55c03a3.slice/crio-10a48d7980945bf241af4a8518b988633a0bf5cc30972ff4fb011dac0fd6ebf9 WatchSource:0}: Error finding container 10a48d7980945bf241af4a8518b988633a0bf5cc30972ff4fb011dac0fd6ebf9: Status 404 returned error can't find the container with id 10a48d7980945bf241af4a8518b988633a0bf5cc30972ff4fb011dac0fd6ebf9 Jun 09 02:27:15.185167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.185134 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" event={"ID":"54ddef67-18c2-4ca4-96bd-8a33a55c03a3","Type":"ContainerStarted","Data":"10a48d7980945bf241af4a8518b988633a0bf5cc30972ff4fb011dac0fd6ebf9"} Jun 09 02:27:15.186554 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.186525 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" event={"ID":"7745cff3-303d-414f-9ed4-f26abcaf0c5e","Type":"ContainerStarted","Data":"51dd73628ed384b1e794c8ece0de24194aca4e5ff60600ae9a98276d702e7908"} Jun 09 02:27:15.186661 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.186647 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:27:15.201556 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:15.201511 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" podStartSLOduration=1.6490982 podStartE2EDuration="4.20149367s" totalImagesPullingTime="2.55239547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:15.20086437 +0000 UTC m=+462.068875237" watchObservedRunningTime="2026-06-09 02:27:15.20149367 +0000 UTC m=+462.069504541" Jun 09 02:27:19.203325 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:19.203291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" event={"ID":"54ddef67-18c2-4ca4-96bd-8a33a55c03a3","Type":"ContainerStarted","Data":"dabd6fcb8d1073a2d78b253aa639103ca7993c63b9da473549df5c0523d3b38b"} Jun 09 02:27:19.219471 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:19.219416 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5687f7b7-hnh9c" podStartSLOduration=1.75345636 podStartE2EDuration="5.219400517s" totalImagesPullingTime="3.465944157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:19.217956624 +0000 UTC m=+466.085967506" watchObservedRunningTime="2026-06-09 02:27:19.219400517 +0000 UTC m=+466.087411388" Jun 09 02:27:26.193884 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:27:26.193850 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-b8xrn" Jun 09 02:29:33.582209 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:29:33.582184 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:29:33.586028 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:29:33.586002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:30:09.339091 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.339052 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:30:09.342267 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.342244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.344650 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.344628 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 02:30:09.345898 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.345871 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nq6h5\"" Jun 09 02:30:09.345898 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.345887 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 02:30:09.346031 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.345895 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 02:30:09.349415 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.349395 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:30:09.378544 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.378511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:30:09.445586 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.445556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-config-file\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.445691 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.445592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbcn\" (UniqueName: \"kubernetes.io/projected/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-kube-api-access-sqbcn\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.546148 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.546114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-config-file\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.546253 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.546155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbcn\" (UniqueName: \"kubernetes.io/projected/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-kube-api-access-sqbcn\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.546710 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.546692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-config-file\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.553747 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.553728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbcn\" (UniqueName: \"kubernetes.io/projected/b711e888-e0dc-4d62-9753-2dc2e0d58c7f-kube-api-access-sqbcn\") pod \"limitador-limitador-54d6d988d5-jzs89\" (UID: \"b711e888-e0dc-4d62-9753-2dc2e0d58c7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.652076 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.652013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:09.743638 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.743608 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:09.746863 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.746841 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:09.749431 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.749414 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7q929\"" Jun 09 02:30:09.754077 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.754022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:09.776016 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.775996 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:30:09.778311 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:30:09.778288 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb711e888_e0dc_4d62_9753_2dc2e0d58c7f.slice/crio-d73d39a778d6e7abca1a1474cf3590d5426bcd92e93fcaa93b0ecb6c4f7383ed WatchSource:0}: Error finding container d73d39a778d6e7abca1a1474cf3590d5426bcd92e93fcaa93b0ecb6c4f7383ed: Status 404 returned error can't find the container with id d73d39a778d6e7abca1a1474cf3590d5426bcd92e93fcaa93b0ecb6c4f7383ed Jun 09 02:30:09.783436 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.783414 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" event={"ID":"b711e888-e0dc-4d62-9753-2dc2e0d58c7f","Type":"ContainerStarted","Data":"d73d39a778d6e7abca1a1474cf3590d5426bcd92e93fcaa93b0ecb6c4f7383ed"} Jun 09 02:30:09.848611 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.848586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7fb\" (UniqueName: \"kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb\") pod \"authorino-58cd955675-rbnxt\" (UID: \"7003397d-e1fe-441b-8e91-936b7dcd9c7e\") " pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:09.931338 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.931269 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:30:09.934316 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.934298 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:30:09.938936 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.938914 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:30:09.949313 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.949292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7fb\" (UniqueName: \"kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb\") pod \"authorino-58cd955675-rbnxt\" (UID: \"7003397d-e1fe-441b-8e91-936b7dcd9c7e\") " pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:09.956705 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:09.956683 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7fb\" (UniqueName: \"kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb\") pod \"authorino-58cd955675-rbnxt\" (UID: \"7003397d-e1fe-441b-8e91-936b7dcd9c7e\") " pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:10.049717 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.049687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwxp\" (UniqueName: \"kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp\") pod \"authorino-75d556bd77-j47g5\" (UID: \"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed\") " pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:30:10.056693 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.056673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:10.150779 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.150730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwxp\" (UniqueName: \"kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp\") pod \"authorino-75d556bd77-j47g5\" (UID: \"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed\") " pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:30:10.159120 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.159065 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwxp\" (UniqueName: \"kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp\") pod \"authorino-75d556bd77-j47g5\" (UID: \"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed\") " pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:30:10.194907 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.194765 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:10.244354 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.244170 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:30:10.406415 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.406283 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:30:10.410513 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:30:10.410476 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod806f0cfb_3db8_4e1f_8f19_82b5c2e274ed.slice/crio-2bef07fcb1f1df9a3a022401bd7ac979b157da124c98f890d3d42c1b62fb210e WatchSource:0}: Error finding container 2bef07fcb1f1df9a3a022401bd7ac979b157da124c98f890d3d42c1b62fb210e: Status 404 returned error can't find the container with id 2bef07fcb1f1df9a3a022401bd7ac979b157da124c98f890d3d42c1b62fb210e Jun 09 02:30:10.789901 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.789858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j47g5" event={"ID":"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed","Type":"ContainerStarted","Data":"2bef07fcb1f1df9a3a022401bd7ac979b157da124c98f890d3d42c1b62fb210e"} Jun 09 02:30:10.791066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:10.791033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbnxt" event={"ID":"7003397d-e1fe-441b-8e91-936b7dcd9c7e","Type":"ContainerStarted","Data":"da8fac55c5240274863be8604be14f0e2263f29dfb0848b8817cbf4d5dc36466"} Jun 09 02:30:14.813727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.813692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbnxt" event={"ID":"7003397d-e1fe-441b-8e91-936b7dcd9c7e","Type":"ContainerStarted","Data":"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca"} Jun 09 02:30:14.815181 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.815158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" event={"ID":"b711e888-e0dc-4d62-9753-2dc2e0d58c7f","Type":"ContainerStarted","Data":"4b7a32898212109eba0f0c42a5f2fdf2a34fc07b3e9d739e769d6dc9aa810ae1"} Jun 09 02:30:14.815307 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.815289 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:30:14.816388 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.816368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j47g5" event={"ID":"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed","Type":"ContainerStarted","Data":"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed"} Jun 09 02:30:14.827301 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.827259 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rbnxt" podStartSLOduration=1.9486357829999998 podStartE2EDuration="5.827248586s" totalImagesPullingTime="3.878612803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:14.82636663 +0000 UTC m=+641.694377499" watchObservedRunningTime="2026-06-09 02:30:14.827248586 +0000 UTC m=+641.695259456" Jun 09 02:30:14.841220 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.841176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-j47g5" podStartSLOduration=2.16101068 podStartE2EDuration="5.841163886s" totalImagesPullingTime="3.680153206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:14.84028388 +0000 UTC m=+641.708294749" watchObservedRunningTime="2026-06-09 02:30:14.841163886 +0000 UTC m=+641.709174757" Jun 09 02:30:14.860068 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.860029 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" podStartSLOduration=1.624711611 podStartE2EDuration="5.860016914s" totalImagesPullingTime="4.235305303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:14.859191277 +0000 UTC m=+641.727202148" watchObservedRunningTime="2026-06-09 02:30:14.860016914 +0000 UTC m=+641.728027785" Jun 09 02:30:14.864148 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:14.864125 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:16.822309 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:16.822263 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rbnxt" podUID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" containerName="authorino" containerID="cri-o://8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca" gracePeriod=30 Jun 09 02:30:17.055039 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.055015 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:17.109015 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.108951 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx7fb\" (UniqueName: \"kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb\") pod \"7003397d-e1fe-441b-8e91-936b7dcd9c7e\" (UID: \"7003397d-e1fe-441b-8e91-936b7dcd9c7e\") " Jun 09 02:30:17.111048 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.111025 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb" (OuterVolumeSpecName: "kube-api-access-qx7fb") pod "7003397d-e1fe-441b-8e91-936b7dcd9c7e" (UID: "7003397d-e1fe-441b-8e91-936b7dcd9c7e"). InnerVolumeSpecName "kube-api-access-qx7fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:30:17.210001 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.209974 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx7fb\" (UniqueName: \"kubernetes.io/projected/7003397d-e1fe-441b-8e91-936b7dcd9c7e-kube-api-access-qx7fb\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:30:17.826674 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.826636 2565 generic.go:356] "Generic (PLEG): container finished" podID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" containerID="8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca" exitCode=0 Jun 09 02:30:17.827095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.826689 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbnxt" Jun 09 02:30:17.827095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.826728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbnxt" event={"ID":"7003397d-e1fe-441b-8e91-936b7dcd9c7e","Type":"ContainerDied","Data":"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca"} Jun 09 02:30:17.827095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.826777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbnxt" event={"ID":"7003397d-e1fe-441b-8e91-936b7dcd9c7e","Type":"ContainerDied","Data":"da8fac55c5240274863be8604be14f0e2263f29dfb0848b8817cbf4d5dc36466"} Jun 09 02:30:17.827095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.826794 2565 scope.go:117] "RemoveContainer" containerID="8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca" Jun 09 02:30:17.834469 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.834452 2565 scope.go:117] "RemoveContainer" containerID="8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca" Jun 09 02:30:17.834700 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:30:17.834683 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca\": container with ID starting with 8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca not found: ID does not exist" containerID="8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca" Jun 09 02:30:17.834748 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.834707 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca"} err="failed to get container status \"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca\": rpc error: code = NotFound desc = could not find container \"8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca\": container with ID starting with 8d83649f15ef7c97c6af75d7c2ef20221aaaa50c2bbeeb9ae367e11aa46a17ca not found: ID does not exist" Jun 09 02:30:17.840981 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.840960 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:17.844249 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:17.844231 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbnxt"] Jun 09 02:30:19.635420 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:19.635389 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" path="/var/lib/kubelet/pods/7003397d-e1fe-441b-8e91-936b7dcd9c7e/volumes" Jun 09 02:30:25.820986 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:30:25.820961 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzs89" Jun 09 02:31:09.675489 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.675457 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:31:09.675972 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.675692 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" containerName="authorino" Jun 09 02:31:09.675972 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.675704 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" containerName="authorino" Jun 09 02:31:09.675972 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.675756 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7003397d-e1fe-441b-8e91-936b7dcd9c7e" containerName="authorino" Jun 09 02:31:09.678537 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.678519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:09.680975 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.680946 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 02:31:09.680975 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.680963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 02:31:09.682127 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.682108 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 02:31:09.682127 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.682123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-h47zn\"" Jun 09 02:31:09.689594 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.689571 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:31:09.779262 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.779226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wjkq\" (UniqueName: \"kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq\") pod \"maas-keycloak-0\" (UID: \"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:09.880632 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.880590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjkq\" (UniqueName: \"kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq\") pod \"maas-keycloak-0\" (UID: \"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:09.888866 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.888841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wjkq\" (UniqueName: \"kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq\") pod \"maas-keycloak-0\" (UID: \"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:09.987272 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:09.987238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:10.109963 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:10.109890 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:31:10.112449 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:31:10.112423 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cc81c4_1ae0_428e_8f31_ed0deaa871a2.slice/crio-5b766b0dcf9208b9d3523c30cb5882ba2e24a78e64627174e9a1d67f0bd32b12 WatchSource:0}: Error finding container 5b766b0dcf9208b9d3523c30cb5882ba2e24a78e64627174e9a1d67f0bd32b12: Status 404 returned error can't find the container with id 5b766b0dcf9208b9d3523c30cb5882ba2e24a78e64627174e9a1d67f0bd32b12 Jun 09 02:31:11.021517 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:11.021473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2","Type":"ContainerStarted","Data":"5b766b0dcf9208b9d3523c30cb5882ba2e24a78e64627174e9a1d67f0bd32b12"} Jun 09 02:31:15.039456 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:15.039423 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2","Type":"ContainerStarted","Data":"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0"} Jun 09 02:31:15.056643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:15.056593 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.7403931 podStartE2EDuration="6.05657892s" totalImagesPullingTime="4.31618582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:15.055048898 +0000 UTC m=+701.923059771" watchObservedRunningTime="2026-06-09 02:31:15.05657892 +0000 UTC m=+701.924589791" Jun 09 02:31:15.988458 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:15.988413 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:15.990359 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:15.990320 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:16.988718 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:16.988668 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:17.988212 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:17.988159 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:18.988310 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:18.988258 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:19.987955 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:19.987897 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:19.988319 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:19.988281 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:20.987739 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:20.987691 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:21.987960 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:21.987895 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:22.988046 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:22.987980 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:23.988259 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:23.988213 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:24.988145 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:24.988092 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:25.988054 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:25.988000 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 09 02:31:27.087732 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:27.087698 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:27.104895 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:27.104576 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:31:37.093268 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:37.093231 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:31:37.957063 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:37.957022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:37.967209 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:37.967171 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:37.967386 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:37.967265 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:38.008208 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.008168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75fnh\" (UniqueName: \"kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh\") pod \"authorino-5d4b67c446-kwdn8\" (UID: \"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a\") " pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:38.108562 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.108524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75fnh\" (UniqueName: \"kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh\") pod \"authorino-5d4b67c446-kwdn8\" (UID: \"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a\") " pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:38.116395 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.116361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75fnh\" (UniqueName: \"kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh\") pod \"authorino-5d4b67c446-kwdn8\" (UID: \"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a\") " pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:38.175284 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.175244 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:38.175477 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.175466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:38.204570 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.204541 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7748df44d7-l458h"] Jun 09 02:31:38.207837 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.207775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:38.216240 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.216199 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7748df44d7-l458h"] Jun 09 02:31:38.309498 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.309456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5tx\" (UniqueName: \"kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx\") pod \"authorino-7748df44d7-l458h\" (UID: \"8ae54333-a491-4041-9af0-eec65122bcda\") " pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:38.311083 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.311057 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:38.313503 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:31:38.313474 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda021ddb8_a77a_43d5_9c2b_04c8cc3dc66a.slice/crio-0a950e7b301abf440d3bf0fc3bfca73f87349253d3e94ad6f3719f9f9bf21482 WatchSource:0}: Error finding container 0a950e7b301abf440d3bf0fc3bfca73f87349253d3e94ad6f3719f9f9bf21482: Status 404 returned error can't find the container with id 0a950e7b301abf440d3bf0fc3bfca73f87349253d3e94ad6f3719f9f9bf21482 Jun 09 02:31:38.314921 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.314904 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:31:38.410564 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.410510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5tx\" (UniqueName: \"kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx\") pod \"authorino-7748df44d7-l458h\" (UID: \"8ae54333-a491-4041-9af0-eec65122bcda\") " pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:38.419779 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.419748 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7748df44d7-l458h"] Jun 09 02:31:38.420015 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:31:38.419996 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jt5tx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7748df44d7-l458h" podUID="8ae54333-a491-4041-9af0-eec65122bcda" Jun 09 02:31:38.423307 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.423281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5tx\" (UniqueName: \"kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx\") pod \"authorino-7748df44d7-l458h\" (UID: \"8ae54333-a491-4041-9af0-eec65122bcda\") " pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:38.443114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.443083 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:31:38.446328 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.446310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.448583 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.448565 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 02:31:38.452550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.452526 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:31:38.511150 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.511058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt4nd\" (UniqueName: \"kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.511150 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.511105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.612465 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.612415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt4nd\" (UniqueName: \"kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.612659 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.612492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.615034 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.615015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.619609 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.619590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt4nd\" (UniqueName: \"kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd\") pod \"authorino-76f8c48c9-xq8hf\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.756175 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.756141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:31:38.884182 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:38.884156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:31:38.886430 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:31:38.886402 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc348b1f_8a74_4510_a509_a248aab357bc.slice/crio-06fe8b25359970953f2971792be10e7db827d464f99ca50a1ff4e86214ac69dd WatchSource:0}: Error finding container 06fe8b25359970953f2971792be10e7db827d464f99ca50a1ff4e86214ac69dd: Status 404 returned error can't find the container with id 06fe8b25359970953f2971792be10e7db827d464f99ca50a1ff4e86214ac69dd Jun 09 02:31:39.144776 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.144674 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" event={"ID":"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a","Type":"ContainerStarted","Data":"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9"} Jun 09 02:31:39.144776 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.144717 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" podUID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" containerName="authorino" containerID="cri-o://34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9" gracePeriod=30 Jun 09 02:31:39.144776 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.144741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" event={"ID":"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a","Type":"ContainerStarted","Data":"0a950e7b301abf440d3bf0fc3bfca73f87349253d3e94ad6f3719f9f9bf21482"} Jun 09 02:31:39.145954 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.145936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:39.146046 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.145928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" event={"ID":"dc348b1f-8a74-4510-a509-a248aab357bc","Type":"ContainerStarted","Data":"06fe8b25359970953f2971792be10e7db827d464f99ca50a1ff4e86214ac69dd"} Jun 09 02:31:39.153681 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.153661 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:39.159353 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.159301 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" podStartSLOduration=1.820325708 podStartE2EDuration="2.159279884s" totalImagesPullingTime="338.954176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:39.157781832 +0000 UTC m=+726.025792705" watchObservedRunningTime="2026-06-09 02:31:39.159279884 +0000 UTC m=+726.027290756" Jun 09 02:31:39.217343 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.217318 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt5tx\" (UniqueName: \"kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx\") pod \"8ae54333-a491-4041-9af0-eec65122bcda\" (UID: \"8ae54333-a491-4041-9af0-eec65122bcda\") " Jun 09 02:31:39.219381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.219299 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx" (OuterVolumeSpecName: "kube-api-access-jt5tx") pod "8ae54333-a491-4041-9af0-eec65122bcda" (UID: "8ae54333-a491-4041-9af0-eec65122bcda"). InnerVolumeSpecName "kube-api-access-jt5tx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:31:39.318654 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.318616 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt5tx\" (UniqueName: \"kubernetes.io/projected/8ae54333-a491-4041-9af0-eec65122bcda-kube-api-access-jt5tx\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:31:39.377215 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.377189 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:39.419994 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.419894 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75fnh\" (UniqueName: \"kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh\") pod \"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a\" (UID: \"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a\") " Jun 09 02:31:39.422026 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.421993 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh" (OuterVolumeSpecName: "kube-api-access-75fnh") pod "a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" (UID: "a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a"). InnerVolumeSpecName "kube-api-access-75fnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:31:39.521421 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:39.521382 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75fnh\" (UniqueName: \"kubernetes.io/projected/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a-kube-api-access-75fnh\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:31:40.150621 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.150588 2565 generic.go:356] "Generic (PLEG): container finished" podID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" containerID="34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9" exitCode=0 Jun 09 02:31:40.151086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.150626 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" Jun 09 02:31:40.151086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.150674 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" event={"ID":"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a","Type":"ContainerDied","Data":"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9"} Jun 09 02:31:40.151086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.150712 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kwdn8" event={"ID":"a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a","Type":"ContainerDied","Data":"0a950e7b301abf440d3bf0fc3bfca73f87349253d3e94ad6f3719f9f9bf21482"} Jun 09 02:31:40.151086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.150730 2565 scope.go:117] "RemoveContainer" containerID="34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9" Jun 09 02:31:40.152274 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.152251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7748df44d7-l458h" Jun 09 02:31:40.152274 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.152253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" event={"ID":"dc348b1f-8a74-4510-a509-a248aab357bc","Type":"ContainerStarted","Data":"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da"} Jun 09 02:31:40.159302 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.159285 2565 scope.go:117] "RemoveContainer" containerID="34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9" Jun 09 02:31:40.159565 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:31:40.159542 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9\": container with ID starting with 34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9 not found: ID does not exist" containerID="34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9" Jun 09 02:31:40.159651 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.159572 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9"} err="failed to get container status \"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9\": rpc error: code = NotFound desc = could not find container \"34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9\": container with ID starting with 34dff6be3f3046d2e6ecb96bd58682fb36c87e965e81cff50f3120121c5df7f9 not found: ID does not exist" Jun 09 02:31:40.165051 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.165027 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:40.167887 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.167866 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwdn8"] Jun 09 02:31:40.178431 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.178381 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" podStartSLOduration=1.851364434 podStartE2EDuration="2.178359091s" totalImagesPullingTime="326.994657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:40.178330994 +0000 UTC m=+727.046341864" watchObservedRunningTime="2026-06-09 02:31:40.178359091 +0000 UTC m=+727.046369961" Jun 09 02:31:40.198963 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.198921 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:31:40.199153 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.199128 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-j47g5" podUID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" containerName="authorino" containerID="cri-o://4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed" gracePeriod=30 Jun 09 02:31:40.200634 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.200614 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7748df44d7-l458h"] Jun 09 02:31:40.204013 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.203991 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7748df44d7-l458h"] Jun 09 02:31:40.454084 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.454061 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:31:40.530566 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.530539 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnwxp\" (UniqueName: \"kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp\") pod \"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed\" (UID: \"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed\") " Jun 09 02:31:40.532605 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.532581 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp" (OuterVolumeSpecName: "kube-api-access-fnwxp") pod "806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" (UID: "806f0cfb-3db8-4e1f-8f19-82b5c2e274ed"). InnerVolumeSpecName "kube-api-access-fnwxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:31:40.631261 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:40.631231 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnwxp\" (UniqueName: \"kubernetes.io/projected/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed-kube-api-access-fnwxp\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:31:41.159317 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.159279 2565 generic.go:356] "Generic (PLEG): container finished" podID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" containerID="4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed" exitCode=0 Jun 09 02:31:41.159783 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.159321 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j47g5" Jun 09 02:31:41.159783 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.159363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j47g5" event={"ID":"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed","Type":"ContainerDied","Data":"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed"} Jun 09 02:31:41.159783 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.159409 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j47g5" event={"ID":"806f0cfb-3db8-4e1f-8f19-82b5c2e274ed","Type":"ContainerDied","Data":"2bef07fcb1f1df9a3a022401bd7ac979b157da124c98f890d3d42c1b62fb210e"} Jun 09 02:31:41.159783 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.159433 2565 scope.go:117] "RemoveContainer" containerID="4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed" Jun 09 02:31:41.167612 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.167593 2565 scope.go:117] "RemoveContainer" containerID="4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed" Jun 09 02:31:41.167879 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:31:41.167860 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed\": container with ID starting with 4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed not found: ID does not exist" containerID="4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed" Jun 09 02:31:41.167931 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.167886 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed"} err="failed to get container status \"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed\": rpc error: code = NotFound desc = could not find container \"4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed\": container with ID starting with 4416212bd52ca6aad411e0f87d769f4d5f31d8ab95f9ea3a5015042f33ed9eed not found: ID does not exist" Jun 09 02:31:41.177685 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.177667 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:31:41.180452 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.180434 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j47g5"] Jun 09 02:31:41.635932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.635902 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" path="/var/lib/kubelet/pods/806f0cfb-3db8-4e1f-8f19-82b5c2e274ed/volumes" Jun 09 02:31:41.636197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.636185 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae54333-a491-4041-9af0-eec65122bcda" path="/var/lib/kubelet/pods/8ae54333-a491-4041-9af0-eec65122bcda/volumes" Jun 09 02:31:41.636359 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:31:41.636350 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" path="/var/lib/kubelet/pods/a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a/volumes" Jun 09 02:32:16.901703 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:16.901664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:32:26.970596 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:26.970543 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:26.971145 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:26.970819 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" containerID="cri-o://4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0" gracePeriod=30 Jun 09 02:32:27.092003 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:27.091960 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:32:28.511751 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:28.511720 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:28.599065 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:28.599028 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wjkq\" (UniqueName: \"kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq\") pod \"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2\" (UID: \"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2\") " Jun 09 02:32:28.601303 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:28.601266 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq" (OuterVolumeSpecName: "kube-api-access-5wjkq") pod "f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" (UID: "f6cc81c4-1ae0-428e-8f31-ed0deaa871a2"). InnerVolumeSpecName "kube-api-access-5wjkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:32:28.700030 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:28.699982 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wjkq\" (UniqueName: \"kubernetes.io/projected/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2-kube-api-access-5wjkq\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:32:29.348983 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.348934 2565 generic.go:356] "Generic (PLEG): container finished" podID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerID="4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0" exitCode=143 Jun 09 02:32:29.348983 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.348982 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.349251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.349009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2","Type":"ContainerDied","Data":"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0"} Jun 09 02:32:29.349251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.349071 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6cc81c4-1ae0-428e-8f31-ed0deaa871a2","Type":"ContainerDied","Data":"5b766b0dcf9208b9d3523c30cb5882ba2e24a78e64627174e9a1d67f0bd32b12"} Jun 09 02:32:29.349251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.349099 2565 scope.go:117] "RemoveContainer" containerID="4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0" Jun 09 02:32:29.358791 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.358774 2565 scope.go:117] "RemoveContainer" containerID="4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0" Jun 09 02:32:29.359059 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:32:29.359041 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0\": container with ID starting with 4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0 not found: ID does not exist" containerID="4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0" Jun 09 02:32:29.359108 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.359067 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0"} err="failed to get container status \"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0\": rpc error: code = NotFound desc = could not find container \"4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0\": container with ID starting with 4e3d51eceeb299e39e30b5a14d3aa317198d4115726cea5462af5916bef4d5a0 not found: ID does not exist" Jun 09 02:32:29.368215 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.368189 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:29.371974 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.371952 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:29.392961 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.392937 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:29.393197 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393185 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" containerName="authorino" Jun 09 02:32:29.393236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393200 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" containerName="authorino" Jun 09 02:32:29.393236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393211 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" containerName="authorino" Jun 09 02:32:29.393236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393217 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" containerName="authorino" Jun 09 02:32:29.393236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393227 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" Jun 09 02:32:29.393236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393232 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" Jun 09 02:32:29.393375 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393291 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="806f0cfb-3db8-4e1f-8f19-82b5c2e274ed" containerName="authorino" Jun 09 02:32:29.393375 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393299 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a021ddb8-a77a-43d5-9c2b-04c8cc3dc66a" containerName="authorino" Jun 09 02:32:29.393375 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.393306 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" containerName="keycloak" Jun 09 02:32:29.397307 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.397291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.399674 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.399653 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 02:32:29.399774 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.399745 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 02:32:29.399860 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.399793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-h47zn\"" Jun 09 02:32:29.399860 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.399829 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 02:32:29.399957 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.399843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 02:32:29.407587 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.407544 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:29.506079 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.506036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txfg\" (UniqueName: \"kubernetes.io/projected/38a2c86d-93cb-4f11-990a-894e1193ff8a-kube-api-access-6txfg\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.506263 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.506100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38a2c86d-93cb-4f11-990a-894e1193ff8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.607402 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.607325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txfg\" (UniqueName: \"kubernetes.io/projected/38a2c86d-93cb-4f11-990a-894e1193ff8a-kube-api-access-6txfg\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.607402 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.607370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38a2c86d-93cb-4f11-990a-894e1193ff8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.608051 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.608034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38a2c86d-93cb-4f11-990a-894e1193ff8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.617194 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.617174 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txfg\" (UniqueName: \"kubernetes.io/projected/38a2c86d-93cb-4f11-990a-894e1193ff8a-kube-api-access-6txfg\") pod \"maas-keycloak-0\" (UID: \"38a2c86d-93cb-4f11-990a-894e1193ff8a\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.636067 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.636037 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6cc81c4-1ae0-428e-8f31-ed0deaa871a2" path="/var/lib/kubelet/pods/f6cc81c4-1ae0-428e-8f31-ed0deaa871a2/volumes" Jun 09 02:32:29.712476 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.712433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:29.838896 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:29.838873 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:32:29.840948 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:32:29.840913 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a2c86d_93cb_4f11_990a_894e1193ff8a.slice/crio-38a7f0f198e5b2b8e0571278e661462ef9e839cfbe8a601be883c812627fad9f WatchSource:0}: Error finding container 38a7f0f198e5b2b8e0571278e661462ef9e839cfbe8a601be883c812627fad9f: Status 404 returned error can't find the container with id 38a7f0f198e5b2b8e0571278e661462ef9e839cfbe8a601be883c812627fad9f Jun 09 02:32:30.356523 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:30.356485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38a2c86d-93cb-4f11-990a-894e1193ff8a","Type":"ContainerStarted","Data":"e9a6257ef0f4d5ccf30a76f6a174662b92013de30a16801603d658e57302d534"} Jun 09 02:32:30.356688 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:30.356544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38a2c86d-93cb-4f11-990a-894e1193ff8a","Type":"ContainerStarted","Data":"38a7f0f198e5b2b8e0571278e661462ef9e839cfbe8a601be883c812627fad9f"} Jun 09 02:32:30.373009 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:30.372955 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.93559745 podStartE2EDuration="1.372936688s" totalImagesPullingTime="437.339238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:30.372253391 +0000 UTC m=+777.240264262" watchObservedRunningTime="2026-06-09 02:32:30.372936688 +0000 UTC m=+777.240947538" Jun 09 02:32:30.712708 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:30.712667 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:30.714053 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:30.714021 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:31.713937 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:31.713890 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:32.713247 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:32.713198 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:33.713896 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:33.713827 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:34.713865 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:34.713789 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:35.713189 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:35.713132 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:36.713353 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:36.713286 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:37.713114 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:37.713069 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:38.713704 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:38.713655 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:39.713224 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:39.713183 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:39.713595 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:39.713563 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:40.713601 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:40.713544 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:41.713754 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:41.713705 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:32:42.803689 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:42.803634 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 02:32:42.817749 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:42.817704 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="38a2c86d-93cb-4f11-990a-894e1193ff8a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:32:52.810393 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:32:52.810296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:03.496560 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.496526 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:33:03.499673 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.499653 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.502151 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.502126 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 02:33:03.508849 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.508825 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:33:03.577496 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.577463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.577496 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.577497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr65m\" (UniqueName: \"kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.577688 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.577518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.678001 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.677970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.678001 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.678002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr65m\" (UniqueName: \"kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.678210 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.678023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.678670 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.678651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.680631 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.680613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.686054 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.686032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr65m\" (UniqueName: \"kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m\") pod \"authorino-cf9c6bb75-pwc4t\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.808905 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.808831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:33:03.930637 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:03.930612 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:33:03.932695 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:33:03.932669 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb86c0123_f937_4130_a03b_cfde544643cc.slice/crio-ea06e42978d49c5018c442fdf3b80bbd3a18e3776f2791f059665225247472b0 WatchSource:0}: Error finding container ea06e42978d49c5018c442fdf3b80bbd3a18e3776f2791f059665225247472b0: Status 404 returned error can't find the container with id ea06e42978d49c5018c442fdf3b80bbd3a18e3776f2791f059665225247472b0 Jun 09 02:33:04.510290 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.510244 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" event={"ID":"b86c0123-f937-4130-a03b-cfde544643cc","Type":"ContainerStarted","Data":"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669"} Jun 09 02:33:04.510735 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.510302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" event={"ID":"b86c0123-f937-4130-a03b-cfde544643cc","Type":"ContainerStarted","Data":"ea06e42978d49c5018c442fdf3b80bbd3a18e3776f2791f059665225247472b0"} Jun 09 02:33:04.526103 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.526051 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" podStartSLOduration=1.171515575 podStartE2EDuration="1.526032564s" totalImagesPullingTime="354.516989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:33:04.525750404 +0000 UTC m=+811.393761286" watchObservedRunningTime="2026-06-09 02:33:04.526032564 +0000 UTC m=+811.394043435" Jun 09 02:33:04.551065 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.550973 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:33:04.551217 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.551188 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" podUID="dc348b1f-8a74-4510-a509-a248aab357bc" containerName="authorino" containerID="cri-o://1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da" gracePeriod=30 Jun 09 02:33:04.812855 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.812731 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:33:04.888047 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.888014 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt4nd\" (UniqueName: \"kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd\") pod \"dc348b1f-8a74-4510-a509-a248aab357bc\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " Jun 09 02:33:04.888204 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.888087 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert\") pod \"dc348b1f-8a74-4510-a509-a248aab357bc\" (UID: \"dc348b1f-8a74-4510-a509-a248aab357bc\") " Jun 09 02:33:04.890296 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.890277 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd" (OuterVolumeSpecName: "kube-api-access-xt4nd") pod "dc348b1f-8a74-4510-a509-a248aab357bc" (UID: "dc348b1f-8a74-4510-a509-a248aab357bc"). InnerVolumeSpecName "kube-api-access-xt4nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:33:04.898562 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.898537 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dc348b1f-8a74-4510-a509-a248aab357bc" (UID: "dc348b1f-8a74-4510-a509-a248aab357bc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:33:04.989241 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.989207 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt4nd\" (UniqueName: \"kubernetes.io/projected/dc348b1f-8a74-4510-a509-a248aab357bc-kube-api-access-xt4nd\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:33:04.989241 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:04.989234 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc348b1f-8a74-4510-a509-a248aab357bc-tls-cert\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:33:05.514957 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.514929 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc348b1f-8a74-4510-a509-a248aab357bc" containerID="1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da" exitCode=0 Jun 09 02:33:05.515381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.514971 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" Jun 09 02:33:05.515381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.515010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" event={"ID":"dc348b1f-8a74-4510-a509-a248aab357bc","Type":"ContainerDied","Data":"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da"} Jun 09 02:33:05.515381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.515040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f8c48c9-xq8hf" event={"ID":"dc348b1f-8a74-4510-a509-a248aab357bc","Type":"ContainerDied","Data":"06fe8b25359970953f2971792be10e7db827d464f99ca50a1ff4e86214ac69dd"} Jun 09 02:33:05.515381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.515057 2565 scope.go:117] "RemoveContainer" containerID="1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da" Jun 09 02:33:05.523865 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.523793 2565 scope.go:117] "RemoveContainer" containerID="1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da" Jun 09 02:33:05.524117 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:33:05.524099 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da\": container with ID starting with 1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da not found: ID does not exist" containerID="1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da" Jun 09 02:33:05.524163 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.524125 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da"} err="failed to get container status \"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da\": rpc error: code = NotFound desc = could not find container \"1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da\": container with ID starting with 1341bdffa8cda82cdde4ebd6aa20505781c5dcf581ae31ccc085012cedeef2da not found: ID does not exist" Jun 09 02:33:05.533968 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.533945 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:33:05.537488 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.537470 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76f8c48c9-xq8hf"] Jun 09 02:33:05.640076 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:05.640042 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc348b1f-8a74-4510-a509-a248aab357bc" path="/var/lib/kubelet/pods/dc348b1f-8a74-4510-a509-a248aab357bc/volumes" Jun 09 02:33:17.089381 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:17.089351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:33:33.682525 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:33.682494 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:33:37.484556 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:37.484517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:33:44.590780 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:44.590737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:33:54.483617 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.483583 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr"] Jun 09 02:33:54.484094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.483857 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc348b1f-8a74-4510-a509-a248aab357bc" containerName="authorino" Jun 09 02:33:54.484094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.483870 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc348b1f-8a74-4510-a509-a248aab357bc" containerName="authorino" Jun 09 02:33:54.484094 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.483928 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc348b1f-8a74-4510-a509-a248aab357bc" containerName="authorino" Jun 09 02:33:54.486914 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.486894 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.490503 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.490480 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fl7xf\"" Jun 09 02:33:54.490503 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.490490 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 02:33:54.490669 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.490481 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 02:33:54.490669 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.490639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 02:33:54.495356 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.495335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr"] Jun 09 02:33:54.550826 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.550826 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.551035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdpt\" (UniqueName: \"kubernetes.io/projected/4f47a4f2-c404-4d54-88d9-6fc8632da853-kube-api-access-ffdpt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.551035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.551035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.551035 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.550951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f47a4f2-c404-4d54-88d9-6fc8632da853-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652001 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.651949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652001 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652231 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdpt\" (UniqueName: \"kubernetes.io/projected/4f47a4f2-c404-4d54-88d9-6fc8632da853-kube-api-access-ffdpt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652231 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652231 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652231 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f47a4f2-c404-4d54-88d9-6fc8632da853-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652433 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652505 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.652550 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.652509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.654342 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.654319 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f47a4f2-c404-4d54-88d9-6fc8632da853-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.654646 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.654632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f47a4f2-c404-4d54-88d9-6fc8632da853-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.659467 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.659444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdpt\" (UniqueName: \"kubernetes.io/projected/4f47a4f2-c404-4d54-88d9-6fc8632da853-kube-api-access-ffdpt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr\" (UID: \"4f47a4f2-c404-4d54-88d9-6fc8632da853\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.797174 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.797097 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:33:54.919571 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:54.919546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr"] Jun 09 02:33:54.921481 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:33:54.921449 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f47a4f2_c404_4d54_88d9_6fc8632da853.slice/crio-a0afa75860f761b10b61f1d5b10ef30705ff6aa7bf1e01ea099b1453704a4cba WatchSource:0}: Error finding container a0afa75860f761b10b61f1d5b10ef30705ff6aa7bf1e01ea099b1453704a4cba: Status 404 returned error can't find the container with id a0afa75860f761b10b61f1d5b10ef30705ff6aa7bf1e01ea099b1453704a4cba Jun 09 02:33:55.186678 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:55.186600 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:33:55.693209 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:55.693166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" event={"ID":"4f47a4f2-c404-4d54-88d9-6fc8632da853","Type":"ContainerStarted","Data":"a0afa75860f761b10b61f1d5b10ef30705ff6aa7bf1e01ea099b1453704a4cba"} Jun 09 02:33:58.704652 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:58.704619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" event={"ID":"4f47a4f2-c404-4d54-88d9-6fc8632da853","Type":"ContainerStarted","Data":"24232e9ae71c4fedba6862329b65c90f470c3ef64bd2df5b120bb5d2c424602f"} Jun 09 02:33:59.709861 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:59.709824 2565 generic.go:356] "Generic (PLEG): container finished" podID="4f47a4f2-c404-4d54-88d9-6fc8632da853" containerID="24232e9ae71c4fedba6862329b65c90f470c3ef64bd2df5b120bb5d2c424602f" exitCode=0 Jun 09 02:33:59.710245 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:33:59.709873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" event={"ID":"4f47a4f2-c404-4d54-88d9-6fc8632da853","Type":"ContainerDied","Data":"24232e9ae71c4fedba6862329b65c90f470c3ef64bd2df5b120bb5d2c424602f"} Jun 09 02:34:01.722342 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:01.722308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" event={"ID":"4f47a4f2-c404-4d54-88d9-6fc8632da853","Type":"ContainerStarted","Data":"aaa93d95e0970e08e18a4cf67b1d63fd172935c6014256418228b0fa02bc0159"} Jun 09 02:34:01.739228 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:01.739180 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" podStartSLOduration=2.196069442 podStartE2EDuration="7.739166787s" totalImagesPullingTime="4.334653469s" totalInitContainerRuntime="1.208443876s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:34:01.738028376 +0000 UTC m=+868.606039238" watchObservedRunningTime="2026-06-09 02:34:01.739166787 +0000 UTC m=+868.607177658" Jun 09 02:34:04.797600 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:04.797567 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:34:04.798067 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:04.797626 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:34:04.810167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:04.810143 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:34:05.747424 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:05.747399 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr" Jun 09 02:34:05.794934 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:05.794902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:34:33.607352 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:33.607278 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:34:33.609295 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:33.609275 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:34:44.150019 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.149984 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f774cccc8-48vzc"] Jun 09 02:34:44.153074 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.153058 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.160302 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.160276 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f774cccc8-48vzc"] Jun 09 02:34:44.239587 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.239545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5p7t\" (UniqueName: \"kubernetes.io/projected/81b8694c-45d8-4b1e-bd37-1452d5d01407-kube-api-access-z5p7t\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.239763 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.239627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/81b8694c-45d8-4b1e-bd37-1452d5d01407-oidc-ca\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.239763 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.239653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b8694c-45d8-4b1e-bd37-1452d5d01407-tls-cert\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.340756 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.340718 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/81b8694c-45d8-4b1e-bd37-1452d5d01407-oidc-ca\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.340756 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.340760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b8694c-45d8-4b1e-bd37-1452d5d01407-tls-cert\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.340954 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.340790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5p7t\" (UniqueName: \"kubernetes.io/projected/81b8694c-45d8-4b1e-bd37-1452d5d01407-kube-api-access-z5p7t\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.341429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.341395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/81b8694c-45d8-4b1e-bd37-1452d5d01407-oidc-ca\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.343258 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.343238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b8694c-45d8-4b1e-bd37-1452d5d01407-tls-cert\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.348315 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.348291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5p7t\" (UniqueName: \"kubernetes.io/projected/81b8694c-45d8-4b1e-bd37-1452d5d01407-kube-api-access-z5p7t\") pod \"authorino-7f774cccc8-48vzc\" (UID: \"81b8694c-45d8-4b1e-bd37-1452d5d01407\") " pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.462670 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.462636 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f774cccc8-48vzc" Jun 09 02:34:44.588836 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.588140 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f774cccc8-48vzc"] Jun 09 02:34:44.594325 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:34:44.594291 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b8694c_45d8_4b1e_bd37_1452d5d01407.slice/crio-2529e92deb02ec1fbffa43aa8b768c378f8bee9e203a8aa1828ed23bfe68d616 WatchSource:0}: Error finding container 2529e92deb02ec1fbffa43aa8b768c378f8bee9e203a8aa1828ed23bfe68d616: Status 404 returned error can't find the container with id 2529e92deb02ec1fbffa43aa8b768c378f8bee9e203a8aa1828ed23bfe68d616 Jun 09 02:34:44.875615 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:44.875522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f774cccc8-48vzc" event={"ID":"81b8694c-45d8-4b1e-bd37-1452d5d01407","Type":"ContainerStarted","Data":"2529e92deb02ec1fbffa43aa8b768c378f8bee9e203a8aa1828ed23bfe68d616"} Jun 09 02:34:45.881774 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:45.881739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f774cccc8-48vzc" event={"ID":"81b8694c-45d8-4b1e-bd37-1452d5d01407","Type":"ContainerStarted","Data":"9c25dc801c7ada16fa13894b1a6aed5d633cd983e857eaef795c3a04d3841615"} Jun 09 02:34:45.897154 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:45.897096 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f774cccc8-48vzc" podStartSLOduration=1.484456894 podStartE2EDuration="1.897079757s" totalImagesPullingTime="412.622863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:34:45.895372807 +0000 UTC m=+912.763383668" watchObservedRunningTime="2026-06-09 02:34:45.897079757 +0000 UTC m=+912.765090627" Jun 09 02:34:45.921112 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:45.921078 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:34:45.921287 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:45.921246 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" podUID="b86c0123-f937-4130-a03b-cfde544643cc" containerName="authorino" containerID="cri-o://c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669" gracePeriod=30 Jun 09 02:34:46.168530 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.168505 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:34:46.258316 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.258281 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca\") pod \"b86c0123-f937-4130-a03b-cfde544643cc\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " Jun 09 02:34:46.258492 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.258345 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr65m\" (UniqueName: \"kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m\") pod \"b86c0123-f937-4130-a03b-cfde544643cc\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " Jun 09 02:34:46.258492 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.258363 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert\") pod \"b86c0123-f937-4130-a03b-cfde544643cc\" (UID: \"b86c0123-f937-4130-a03b-cfde544643cc\") " Jun 09 02:34:46.260484 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.260447 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m" (OuterVolumeSpecName: "kube-api-access-zr65m") pod "b86c0123-f937-4130-a03b-cfde544643cc" (UID: "b86c0123-f937-4130-a03b-cfde544643cc"). InnerVolumeSpecName "kube-api-access-zr65m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:34:46.262522 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.262494 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b86c0123-f937-4130-a03b-cfde544643cc" (UID: "b86c0123-f937-4130-a03b-cfde544643cc"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:34:46.267101 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.267079 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b86c0123-f937-4130-a03b-cfde544643cc" (UID: "b86c0123-f937-4130-a03b-cfde544643cc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:34:46.359430 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.359395 2565 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b86c0123-f937-4130-a03b-cfde544643cc-oidc-ca\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:34:46.359430 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.359426 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr65m\" (UniqueName: \"kubernetes.io/projected/b86c0123-f937-4130-a03b-cfde544643cc-kube-api-access-zr65m\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:34:46.359430 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.359435 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b86c0123-f937-4130-a03b-cfde544643cc-tls-cert\") on node \"ip-10-0-133-232.ec2.internal\" DevicePath \"\"" Jun 09 02:34:46.889731 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.889689 2565 generic.go:356] "Generic (PLEG): container finished" podID="b86c0123-f937-4130-a03b-cfde544643cc" containerID="c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669" exitCode=0 Jun 09 02:34:46.890141 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.889727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" event={"ID":"b86c0123-f937-4130-a03b-cfde544643cc","Type":"ContainerDied","Data":"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669"} Jun 09 02:34:46.890141 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.889774 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" event={"ID":"b86c0123-f937-4130-a03b-cfde544643cc","Type":"ContainerDied","Data":"ea06e42978d49c5018c442fdf3b80bbd3a18e3776f2791f059665225247472b0"} Jun 09 02:34:46.890141 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.889791 2565 scope.go:117] "RemoveContainer" containerID="c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669" Jun 09 02:34:46.890141 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.889740 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9c6bb75-pwc4t" Jun 09 02:34:46.898281 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.898267 2565 scope.go:117] "RemoveContainer" containerID="c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669" Jun 09 02:34:46.898513 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:34:46.898495 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669\": container with ID starting with c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669 not found: ID does not exist" containerID="c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669" Jun 09 02:34:46.898556 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.898524 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669"} err="failed to get container status \"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669\": rpc error: code = NotFound desc = could not find container \"c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669\": container with ID starting with c6d24aaaffa3ddf936308128d020c04e90a81a5d2ffaa9aac4ca9330e5836669 not found: ID does not exist" Jun 09 02:34:46.908580 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.908558 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:34:46.910645 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:46.910626 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cf9c6bb75-pwc4t"] Jun 09 02:34:47.636174 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:34:47.636134 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86c0123-f937-4130-a03b-cfde544643cc" path="/var/lib/kubelet/pods/b86c0123-f937-4130-a03b-cfde544643cc/volumes" Jun 09 02:35:17.185968 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:35:17.185933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:35:27.680753 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:35:27.680722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:35:36.290830 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:35:36.290756 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:35:46.482147 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:35:46.482064 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:35:55.683881 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:35:55.683839 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:36:05.989015 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:36:05.988972 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:36:40.488097 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:36:40.488061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:36:43.381659 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:36:43.381618 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:36:48.979040 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:36:48.979001 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:36:51.377337 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:36:51.377299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:37:19.787582 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:37:19.787493 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:37:36.089254 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:37:36.089220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:38:13.987990 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:38:13.987957 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:38:31.087438 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:38:31.087408 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:38:45.090193 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:38:45.090119 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:39:01.182126 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:39:01.182085 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:39:33.630347 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:39:33.630320 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:39:33.630866 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:39:33.630683 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:39:38.692376 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:39:38.692338 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:39:41.582376 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:39:41.582337 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:40:03.983680 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:40:03.983647 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:40:13.189377 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:40:13.189337 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:40:29.689652 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:40:29.689577 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:40:38.487464 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:40:38.487430 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:40:55.292052 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:40:55.292013 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:41:03.681727 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:41:03.681692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:41:36.388869 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:41:36.388835 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:41:44.996387 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:41:44.996307 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:41:53.185782 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:41:53.185739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:01.482270 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:01.482231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:09.891776 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:09.891735 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:18.282779 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:18.282733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:20.782275 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:20.782239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:27.081480 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:27.081448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:42:38.481646 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:42:38.481608 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:15.485982 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:15.485907 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:17.481535 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:17.481502 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:25.888694 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:25.888660 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:29.086433 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:29.086394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:37.579858 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:37.579824 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:44.890215 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:44.890181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:43:54.782906 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:43:54.782869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:02.987327 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:02.987295 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:11.785639 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:11.785600 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:15.288008 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:15.287973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:20.385440 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:20.385407 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:29.984580 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:29.984547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:33.659871 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:33.659843 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:44:33.666491 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:33.666455 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:44:37.690014 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:37.689984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:47.385761 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:47.385677 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:44:55.384546 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:44:55.384511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:04.791234 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:04.791196 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:12.687009 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:12.686975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:22.284820 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:22.284777 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:29.385754 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:29.385718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:39.485536 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:39.485501 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:45:48.182136 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:45:48.182101 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:06.780500 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:06.780420 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:09.691249 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:09.691221 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:36.182620 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:36.182591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:40.285572 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:40.285537 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:50.088304 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:50.088272 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:48:59.487448 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:48:59.487412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:09.592598 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:09.592559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:19.689252 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:19.689175 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:28.991663 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:28.991627 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:33.685684 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:33.685657 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:49:33.687790 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:33.687769 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:49:38.189098 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:38.189060 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:48.184839 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:48.184788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:49:57.689820 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:49:57.689781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:50:06.588658 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:50:06.588621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:50:09.290507 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:50:09.290473 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:50:39.985474 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:50:39.985435 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:51:23.397311 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:51:23.397269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:51:31.886558 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:51:31.886516 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:51:40.626513 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:51:40.626479 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:51:48.390902 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:51:48.390865 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:51:57.983421 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:51:57.983377 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:07.690220 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:07.690180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:17.881985 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:17.881898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:22.388818 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:22.388758 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:31.403407 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:31.403371 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:39.384325 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:39.384289 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:47.487658 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:47.487624 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:52:57.885414 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:52:57.885368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:53:16.189815 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:53:16.189778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:53:24.190044 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:53:24.190000 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:53:33.580043 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:53:33.580003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:53:41.587581 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:53:41.587548 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:53:58.986103 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:53:58.986022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:06.693251 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:06.693218 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:16.085436 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:16.085396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:24.687238 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:24.687203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:33.480438 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:33.480397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:33.706066 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:33.706039 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:54:33.708578 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:33.708557 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:54:41.283516 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:41.283479 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:54:51.491051 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:54:51.491018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:00.784565 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:00.784530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:03.583932 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:03.583895 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:11.292959 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:11.292924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:21.584422 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:21.584336 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:31.383963 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:31.383927 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:36.190225 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:36.190189 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:45.886227 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:45.886197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:55:51.013339 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:55:51.013296 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:56:06.886108 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:56:06.886072 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:56:15.887172 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:56:15.887132 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:56:24.793234 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:56:24.793197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:56:29.990226 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:56:29.990194 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:56:53.885673 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:56:53.885586 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:57:07.282677 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:07.282632 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:57:08.161399 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.161324 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f"] Jun 09 02:57:08.161697 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.161681 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86c0123-f937-4130-a03b-cfde544643cc" containerName="authorino" Jun 09 02:57:08.161738 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.161700 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86c0123-f937-4130-a03b-cfde544643cc" containerName="authorino" Jun 09 02:57:08.161782 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.161773 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86c0123-f937-4130-a03b-cfde544643cc" containerName="authorino" Jun 09 02:57:08.164484 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.164470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.168170 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.168146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 02:57:08.168301 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.168143 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 02:57:08.168301 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.168195 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 02:57:08.168301 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.168211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-xd8sj\"" Jun 09 02:57:08.174339 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.174316 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f"] Jun 09 02:57:08.224986 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.224952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px8sp\" (UniqueName: \"kubernetes.io/projected/2746d622-a249-47c5-8599-b0ca9e8eaacd-kube-api-access-px8sp\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.225107 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.225000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2746d622-a249-47c5-8599-b0ca9e8eaacd-maas-api-tls\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.326152 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.326123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px8sp\" (UniqueName: \"kubernetes.io/projected/2746d622-a249-47c5-8599-b0ca9e8eaacd-kube-api-access-px8sp\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.326488 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.326169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2746d622-a249-47c5-8599-b0ca9e8eaacd-maas-api-tls\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.328643 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.328625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2746d622-a249-47c5-8599-b0ca9e8eaacd-maas-api-tls\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.334441 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.334419 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px8sp\" (UniqueName: \"kubernetes.io/projected/2746d622-a249-47c5-8599-b0ca9e8eaacd-kube-api-access-px8sp\") pod \"maas-api-e2e-ait-a6a08889-6548945f97-mh46f\" (UID: \"2746d622-a249-47c5-8599-b0ca9e8eaacd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.474543 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.474503 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:08.607641 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.607615 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f"] Jun 09 02:57:08.610061 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:57:08.610034 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2746d622_a249_47c5_8599_b0ca9e8eaacd.slice/crio-df6f0739725fd35d99d6b7e5604e1648864eac1c583e8752970d1f97cc8c41b7 WatchSource:0}: Error finding container df6f0739725fd35d99d6b7e5604e1648864eac1c583e8752970d1f97cc8c41b7: Status 404 returned error can't find the container with id df6f0739725fd35d99d6b7e5604e1648864eac1c583e8752970d1f97cc8c41b7 Jun 09 02:57:08.611246 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.611229 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:57:08.682109 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:08.682079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" event={"ID":"2746d622-a249-47c5-8599-b0ca9e8eaacd","Type":"ContainerStarted","Data":"df6f0739725fd35d99d6b7e5604e1648864eac1c583e8752970d1f97cc8c41b7"} Jun 09 02:57:11.582623 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:11.582591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzs89"] Jun 09 02:57:11.695383 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:11.695348 2565 generic.go:356] "Generic (PLEG): container finished" podID="2746d622-a249-47c5-8599-b0ca9e8eaacd" containerID="03832ce7595545a3fda5ad7ed19fffb88c5d6b344d7432dcc0ef5b2da98bc7a4" exitCode=1 Jun 09 02:57:11.695563 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:11.695408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" event={"ID":"2746d622-a249-47c5-8599-b0ca9e8eaacd","Type":"ContainerDied","Data":"03832ce7595545a3fda5ad7ed19fffb88c5d6b344d7432dcc0ef5b2da98bc7a4"} Jun 09 02:57:11.695633 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:11.695606 2565 scope.go:117] "RemoveContainer" containerID="03832ce7595545a3fda5ad7ed19fffb88c5d6b344d7432dcc0ef5b2da98bc7a4" Jun 09 02:57:12.700546 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:12.700512 2565 generic.go:356] "Generic (PLEG): container finished" podID="2746d622-a249-47c5-8599-b0ca9e8eaacd" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" exitCode=1 Jun 09 02:57:12.700959 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:12.700553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" event={"ID":"2746d622-a249-47c5-8599-b0ca9e8eaacd","Type":"ContainerDied","Data":"669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284"} Jun 09 02:57:12.700959 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:12.700608 2565 scope.go:117] "RemoveContainer" containerID="03832ce7595545a3fda5ad7ed19fffb88c5d6b344d7432dcc0ef5b2da98bc7a4" Jun 09 02:57:12.700959 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:12.700827 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:12.701082 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:12.701015 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:13.475068 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:13.475037 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:13.706324 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:13.706292 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:13.706684 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:13.706434 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:14.710493 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:14.710468 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:14.710940 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:14.710642 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:18.475086 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:18.475049 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:18.475515 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:18.475496 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:18.475709 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:18.475686 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:20.427199 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.427162 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25"] Jun 09 02:57:20.431494 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.431473 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.440342 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.440317 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25"] Jun 09 02:57:20.512517 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.512479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwhsp\" (UniqueName: \"kubernetes.io/projected/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-kube-api-access-rwhsp\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.512673 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.512533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-maas-api-tls\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.613586 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.613551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwhsp\" (UniqueName: \"kubernetes.io/projected/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-kube-api-access-rwhsp\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.613710 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.613596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-maas-api-tls\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.616095 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.616067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-maas-api-tls\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.632038 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.632011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwhsp\" (UniqueName: \"kubernetes.io/projected/e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc-kube-api-access-rwhsp\") pod \"maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25\" (UID: \"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.742102 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.742074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:20.877236 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:20.877201 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25"] Jun 09 02:57:20.879997 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:57:20.879966 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c6bf42_92d1_4dfd_8951_b9f167b5d8cc.slice/crio-2a53313433f9a584fe9596e576d40ae3a28e9fff292998c8a5bed0e4656d176d WatchSource:0}: Error finding container 2a53313433f9a584fe9596e576d40ae3a28e9fff292998c8a5bed0e4656d176d: Status 404 returned error can't find the container with id 2a53313433f9a584fe9596e576d40ae3a28e9fff292998c8a5bed0e4656d176d Jun 09 02:57:21.737577 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:21.737542 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" containerID="5962ce5fd781854aa6f4974d6779e129b75325bfd4ea7f8abff905c19c028879" exitCode=1 Jun 09 02:57:21.737956 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:21.737596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" event={"ID":"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc","Type":"ContainerDied","Data":"5962ce5fd781854aa6f4974d6779e129b75325bfd4ea7f8abff905c19c028879"} Jun 09 02:57:21.737956 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:21.737643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" event={"ID":"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc","Type":"ContainerStarted","Data":"2a53313433f9a584fe9596e576d40ae3a28e9fff292998c8a5bed0e4656d176d"} Jun 09 02:57:21.737956 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:21.737835 2565 scope.go:117] "RemoveContainer" containerID="5962ce5fd781854aa6f4974d6779e129b75325bfd4ea7f8abff905c19c028879" Jun 09 02:57:22.743989 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:22.743957 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" exitCode=1 Jun 09 02:57:22.744379 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:22.744040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" event={"ID":"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc","Type":"ContainerDied","Data":"87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04"} Jun 09 02:57:22.744379 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:22.744092 2565 scope.go:117] "RemoveContainer" containerID="5962ce5fd781854aa6f4974d6779e129b75325bfd4ea7f8abff905c19c028879" Jun 09 02:57:22.744379 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:22.744219 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:22.744534 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:22.744414 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:23.750014 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:23.749987 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:23.750347 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:23.750151 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:25.742653 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:25.742623 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:25.743048 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:25.742948 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:25.743124 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:25.743105 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:29.631821 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:29.631782 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:30.743099 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.743072 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:30.743429 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.743378 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:30.743528 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:30.743508 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:30.784110 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.784086 2565 generic.go:356] "Generic (PLEG): container finished" podID="2746d622-a249-47c5-8599-b0ca9e8eaacd" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" exitCode=1 Jun 09 02:57:30.784223 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.784164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" event={"ID":"2746d622-a249-47c5-8599-b0ca9e8eaacd","Type":"ContainerDied","Data":"4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36"} Jun 09 02:57:30.784223 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.784217 2565 scope.go:117] "RemoveContainer" containerID="669b2c5a26292acf5492952c262439c7ff83bf92cf56a104966645584c7a4284" Jun 09 02:57:30.784556 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:30.784540 2565 scope.go:117] "RemoveContainer" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" Jun 09 02:57:30.784697 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:30.784675 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:33.475074 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:33.475041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:33.475439 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:33.475359 2565 scope.go:117] "RemoveContainer" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" Jun 09 02:57:33.475546 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:33.475526 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:38.475176 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:38.475137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:38.475613 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:38.475531 2565 scope.go:117] "RemoveContainer" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" Jun 09 02:57:38.475701 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:38.475679 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:39.560790 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:39.560740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f774cccc8-48vzc_81b8694c-45d8-4b1e-bd37-1452d5d01407/authorino/0.log" Jun 09 02:57:44.630844 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:44.630790 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:44.848875 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:44.848847 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-gtsnk_7b222daa-96e0-4f31-a5e0-b00987a2738a/copy-manifests/0.log" Jun 09 02:57:44.855944 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:44.855920 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-gtsnk_7b222daa-96e0-4f31-a5e0-b00987a2738a/manager/0.log" Jun 09 02:57:45.844762 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:45.844729 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" exitCode=1 Jun 09 02:57:45.845226 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:45.844820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" event={"ID":"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc","Type":"ContainerDied","Data":"4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72"} Jun 09 02:57:45.845226 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:45.844892 2565 scope.go:117] "RemoveContainer" containerID="87fa417c3f1b19686be142c3d1ba8a89301b83d643003cea99e18934e67f5f04" Jun 09 02:57:45.845226 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:45.845197 2565 scope.go:117] "RemoveContainer" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" Jun 09 02:57:45.845401 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:45.845380 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:46.209714 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:46.209684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f774cccc8-48vzc_81b8694c-45d8-4b1e-bd37-1452d5d01407/authorino/0.log" Jun 09 02:57:46.882241 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:46.882211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jzs89_b711e888-e0dc-4d62-9753-2dc2e0d58c7f/limitador/0.log" Jun 09 02:57:47.658696 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:47.658660 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-hnh9c_54ddef67-18c2-4ca4-96bd-8a33a55c03a3/kube-auth-proxy/0.log" Jun 09 02:57:48.679155 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:48.679124 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr_4f47a4f2-c404-4d54-88d9-6fc8632da853/storage-initializer/0.log" Jun 09 02:57:48.686522 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:48.686501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4pkkr_4f47a4f2-c404-4d54-88d9-6fc8632da853/main/0.log" Jun 09 02:57:50.630839 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:50.630793 2565 scope.go:117] "RemoveContainer" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" Jun 09 02:57:50.742160 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:50.742130 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:50.742309 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:50.742225 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:57:50.742504 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:50.742488 2565 scope.go:117] "RemoveContainer" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" Jun 09 02:57:50.742690 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:50.742669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:50.863514 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:50.863488 2565 scope.go:117] "RemoveContainer" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" Jun 09 02:57:50.863666 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:50.863635 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:57:51.868536 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:51.868504 2565 generic.go:356] "Generic (PLEG): container finished" podID="2746d622-a249-47c5-8599-b0ca9e8eaacd" containerID="9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543" exitCode=1 Jun 09 02:57:51.869022 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:51.868581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" event={"ID":"2746d622-a249-47c5-8599-b0ca9e8eaacd","Type":"ContainerDied","Data":"9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543"} Jun 09 02:57:51.869022 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:51.868642 2565 scope.go:117] "RemoveContainer" containerID="4bd47b646002bb517396af070cfe24f66393d253af8e9f315be117032f5b7b36" Jun 09 02:57:51.869022 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:51.868970 2565 scope.go:117] "RemoveContainer" containerID="9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543" Jun 09 02:57:51.869208 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:51.869187 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:53.475439 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:53.475400 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:53.475936 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:53.475833 2565 scope.go:117] "RemoveContainer" containerID="9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543" Jun 09 02:57:53.476043 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:53.476022 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:57:55.933186 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:55.933153 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g59z2_4b858869-7a1b-4979-bbee-fdcf55692c2d/global-pull-secret-syncer/0.log" Jun 09 02:57:56.043971 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:56.043933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vk9kz_fa1c0173-56da-4808-8322-3e6d029d848d/konnectivity-agent/0.log" Jun 09 02:57:56.083777 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:56.083745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-232.ec2.internal_fdf289ebef9629ba86a70af54a7ac16a/haproxy/0.log" Jun 09 02:57:58.474818 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:58.474773 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" Jun 09 02:57:58.475316 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:57:58.475167 2565 scope.go:117] "RemoveContainer" containerID="9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543" Jun 09 02:57:58.475383 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:57:58.475317 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:58:01.180473 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:01.180439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f774cccc8-48vzc_81b8694c-45d8-4b1e-bd37-1452d5d01407/authorino/0.log" Jun 09 02:58:01.467612 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:01.467581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jzs89_b711e888-e0dc-4d62-9753-2dc2e0d58c7f/limitador/0.log" Jun 09 02:58:03.461162 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:03.461136 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/node-exporter/0.log" Jun 09 02:58:03.480556 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:03.480529 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/kube-rbac-proxy/0.log" Jun 09 02:58:03.499446 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:03.499415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrjzv_6e5619b9-84a6-4175-97bd-582ff0a96337/init-textfile/0.log" Jun 09 02:58:05.631154 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:05.631114 2565 scope.go:117] "RemoveContainer" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" Jun 09 02:58:06.927654 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:06.927620 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" containerID="22642f00b9116179546fed0373aaa2c0147a107767b2424abac0748f80e2c287" exitCode=1 Jun 09 02:58:06.928115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:06.927688 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" event={"ID":"e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc","Type":"ContainerDied","Data":"22642f00b9116179546fed0373aaa2c0147a107767b2424abac0748f80e2c287"} Jun 09 02:58:06.928115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:06.927780 2565 scope.go:117] "RemoveContainer" containerID="4896713a3f2c055ae5506522c5656a759124eb98a35fadd914468c6cb2235f72" Jun 09 02:58:06.928234 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:06.928123 2565 scope.go:117] "RemoveContainer" containerID="22642f00b9116179546fed0373aaa2c0147a107767b2424abac0748f80e2c287" Jun 09 02:58:06.928382 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:58:06.928359 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:58:07.291518 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.291482 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w"] Jun 09 02:58:07.297036 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.297011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.299448 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.299426 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"openshift-service-ca.crt\"" Jun 09 02:58:07.299581 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.299464 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"kube-root-ca.crt\"" Jun 09 02:58:07.299649 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.299590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xdkm6\"/\"default-dockercfg-xh6kn\"" Jun 09 02:58:07.301987 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.301966 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w"] Jun 09 02:58:07.473625 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.473593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vb7x\" (UniqueName: \"kubernetes.io/projected/ae961a8e-0aba-4826-b7b6-6b3420127254-kube-api-access-9vb7x\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.473625 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.473635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-lib-modules\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.473856 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.473664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-podres\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.473856 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.473740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-proc\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.473856 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.473820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-sys\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.574964 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.574883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-lib-modules\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.574964 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.574922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-podres\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575130 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-podres\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575130 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-lib-modules\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575130 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-proc\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575130 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-proc\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575244 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-sys\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575244 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vb7x\" (UniqueName: \"kubernetes.io/projected/ae961a8e-0aba-4826-b7b6-6b3420127254-kube-api-access-9vb7x\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.575244 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.575227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae961a8e-0aba-4826-b7b6-6b3420127254-sys\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.582571 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.582549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vb7x\" (UniqueName: \"kubernetes.io/projected/ae961a8e-0aba-4826-b7b6-6b3420127254-kube-api-access-9vb7x\") pod \"perf-node-gather-daemonset-p527w\" (UID: \"ae961a8e-0aba-4826-b7b6-6b3420127254\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.607596 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.607577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.730189 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.730164 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w"] Jun 09 02:58:07.732346 ip-10-0-133-232 kubenswrapper[2565]: W0609 02:58:07.732319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae961a8e_0aba_4826_b7b6_6b3420127254.slice/crio-8ebd6c5940161fe5273e5bf7ce6a4f1cb792baea0ba82160a456a5ce95f80d19 WatchSource:0}: Error finding container 8ebd6c5940161fe5273e5bf7ce6a4f1cb792baea0ba82160a456a5ce95f80d19: Status 404 returned error can't find the container with id 8ebd6c5940161fe5273e5bf7ce6a4f1cb792baea0ba82160a456a5ce95f80d19 Jun 09 02:58:07.937794 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.937705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" event={"ID":"ae961a8e-0aba-4826-b7b6-6b3420127254","Type":"ContainerStarted","Data":"7d663b20945c21fccf09b8ecc505e0410d39711b01cac1f5568960e8515fae2e"} Jun 09 02:58:07.937794 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.937755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" event={"ID":"ae961a8e-0aba-4826-b7b6-6b3420127254","Type":"ContainerStarted","Data":"8ebd6c5940161fe5273e5bf7ce6a4f1cb792baea0ba82160a456a5ce95f80d19"} Jun 09 02:58:07.938294 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.937826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:07.952271 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:07.952224 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" podStartSLOduration=0.952209009 podStartE2EDuration="952.209009ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:58:07.951570583 +0000 UTC m=+2314.819581455" watchObservedRunningTime="2026-06-09 02:58:07.952209009 +0000 UTC m=+2314.820219878" Jun 09 02:58:08.452178 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:08.452152 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjfz5_adb62621-2b85-40af-8d49-89a2ef736ef5/dns/0.log" Jun 09 02:58:08.471834 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:08.471814 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjfz5_adb62621-2b85-40af-8d49-89a2ef736ef5/kube-rbac-proxy/0.log" Jun 09 02:58:08.540744 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:08.540712 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkxtz_a9294c4c-5b86-47ad-93be-d948e2111f37/dns-node-resolver/0.log" Jun 09 02:58:09.083759 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:09.083729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpnbh_cc8b9176-454b-4507-8d60-a49a1356b2d7/node-ca/0.log" Jun 09 02:58:10.105026 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:10.104999 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-hnh9c_54ddef67-18c2-4ca4-96bd-8a33a55c03a3/kube-auth-proxy/0.log" Jun 09 02:58:10.742371 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:10.742334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:58:10.742564 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:10.742396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" Jun 09 02:58:10.742723 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:10.742711 2565 scope.go:117] "RemoveContainer" containerID="22642f00b9116179546fed0373aaa2c0147a107767b2424abac0748f80e2c287" Jun 09 02:58:10.742919 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:58:10.742900 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:58:10.799052 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:10.799020 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9crsx_488047d2-5a92-4fe2-9ac7-a954cbfe88d1/serve-healthcheck-canary/0.log" Jun 09 02:58:11.435423 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:11.435391 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgjsj_0e09fb3c-ac1d-416a-866f-020f203a6d78/kube-rbac-proxy/0.log" Jun 09 02:58:11.455871 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:11.455848 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgjsj_0e09fb3c-ac1d-416a-866f-020f203a6d78/exporter/0.log" Jun 09 02:58:11.476332 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:11.476304 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgjsj_0e09fb3c-ac1d-416a-866f-020f203a6d78/extractor/0.log" Jun 09 02:58:11.631285 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:11.631251 2565 scope.go:117] "RemoveContainer" containerID="9dd96e53a58a7bf7b1c8e64ac9cace08d2861efa38e4fd913330871289c7a543" Jun 09 02:58:11.631473 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:58:11.631417 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a6a08889-6548945f97-mh46f_redhat-ai-gateway-infra(2746d622-a249-47c5-8599-b0ca9e8eaacd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-a6a08889-6548945f97-mh46f" podUID="2746d622-a249-47c5-8599-b0ca9e8eaacd" Jun 09 02:58:13.951634 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:13.951607 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-p527w" Jun 09 02:58:14.151845 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:14.151818 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-gtsnk_7b222daa-96e0-4f31-a5e0-b00987a2738a/manager/0.log" Jun 09 02:58:14.169736 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:14.169711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-gtsnk_7b222daa-96e0-4f31-a5e0-b00987a2738a/copy-manifests/0.log" Jun 09 02:58:15.657364 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:15.657286 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67785bd58c-b8xrn_7745cff3-303d-414f-9ed4-f26abcaf0c5e/manager/0.log" Jun 09 02:58:19.867519 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:19.867479 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-hnh9c_54ddef67-18c2-4ca4-96bd-8a33a55c03a3/kube-auth-proxy/0.log" Jun 09 02:58:21.302721 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:21.302691 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-hnh9c_54ddef67-18c2-4ca4-96bd-8a33a55c03a3/kube-auth-proxy/0.log" Jun 09 02:58:22.387914 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.387887 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6j5mp_bdf350e6-7f2a-49e3-a2d4-753ff5fff0da/kube-multus/0.log" Jun 09 02:58:22.631621 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.631600 2565 scope.go:117] "RemoveContainer" containerID="22642f00b9116179546fed0373aaa2c0147a107767b2424abac0748f80e2c287" Jun 09 02:58:22.631796 ip-10-0-133-232 kubenswrapper[2565]: E0609 02:58:22.631779 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25_redhat-ai-gateway-infra(e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-2fb17c08-8cbbc4fc5-s7q25" podUID="e8c6bf42-92d1-4dfd-8951-b9f167b5d8cc" Jun 09 02:58:22.714167 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.714145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/kube-multus-additional-cni-plugins/0.log" Jun 09 02:58:22.733490 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.733467 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/egress-router-binary-copy/0.log" Jun 09 02:58:22.751987 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.751966 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/cni-plugins/0.log" Jun 09 02:58:22.772115 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.772093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/bond-cni-plugin/0.log" Jun 09 02:58:22.790520 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.790497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/routeoverride-cni/0.log" Jun 09 02:58:22.809165 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.809145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/whereabouts-cni-bincopy/0.log" Jun 09 02:58:22.827914 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.827890 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbps4_5a5c23a7-4eae-4ba0-904d-e875493a6c1e/whereabouts-cni/0.log" Jun 09 02:58:22.920503 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.920473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cdmms_03529f88-6f83-4511-993e-0cfafdb127e5/network-metrics-daemon/0.log" Jun 09 02:58:22.939538 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:22.939512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cdmms_03529f88-6f83-4511-993e-0cfafdb127e5/kube-rbac-proxy/0.log" Jun 09 02:58:23.016273 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.016197 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-hnh9c_54ddef67-18c2-4ca4-96bd-8a33a55c03a3/kube-auth-proxy/0.log" Jun 09 02:58:23.929281 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.929234 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-controller/0.log" Jun 09 02:58:23.944734 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.944703 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/1.log" Jun 09 02:58:23.944911 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.944710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovn-acl-logging/0.log" Jun 09 02:58:23.966257 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.966227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/kube-rbac-proxy-node/0.log" Jun 09 02:58:23.987924 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:23.987901 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 02:58:24.002499 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:24.002480 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/northd/0.log" Jun 09 02:58:24.020933 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:24.020913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/nbdb/0.log" Jun 09 02:58:24.040768 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:24.040750 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/sbdb/0.log" Jun 09 02:58:24.105368 ip-10-0-133-232 kubenswrapper[2565]: I0609 02:58:24.105334 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qgk7_f7f518ba-c1f1-4714-ba72-40422d175ba6/ovnkube-controller/0.log"