Jun 05 03:43:04.594402 ip-10-0-139-39 systemd[1]: Starting Kubernetes Kubelet... Jun 05 03:43:05.041638 ip-10-0-139-39 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:05.041638 ip-10-0-139-39 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 03:43:05.041638 ip-10-0-139-39 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:05.041638 ip-10-0-139-39 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 03:43:05.042766 ip-10-0-139-39 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:05.042766 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.042624 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 03:43:05.048623 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048594 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.048623 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048620 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.048623 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048624 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.048623 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048628 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048632 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048635 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048639 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048642 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048645 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048648 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048651 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048654 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048657 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048660 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048662 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048667 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048671 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048676 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048679 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048681 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048684 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048687 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048689 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.048767 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048692 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048695 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048697 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048700 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048703 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048705 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048708 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048710 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048713 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048715 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048718 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048721 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048723 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048726 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048729 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048732 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048735 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048739 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048741 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048744 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.049274 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048746 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048749 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048752 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048754 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048757 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048761 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048763 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048766 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048769 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048772 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048775 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048777 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048781 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048784 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048786 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048789 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048791 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048794 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048796 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048799 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.049762 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048801 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048804 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048806 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048809 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048811 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048814 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048817 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048820 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048825 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048828 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048832 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048834 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048837 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048840 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048843 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048846 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048848 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048850 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048855 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.050283 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048859 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048862 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048865 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048868 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048870 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048873 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048875 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048878 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048881 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048883 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048885 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048889 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048891 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048894 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048896 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048899 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.048901 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049658 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049666 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.050743 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049670 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049673 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049676 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049679 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049681 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049685 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049690 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049693 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049695 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049698 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049701 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049703 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049706 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049709 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049712 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049715 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049718 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049720 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049723 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049725 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.051277 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049728 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049731 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049733 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049736 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049738 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049741 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049744 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049746 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049750 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049752 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049755 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049758 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049761 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049764 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049767 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049771 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049773 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049776 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049779 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049782 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.052083 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049787 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049790 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049793 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049796 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049799 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049802 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049805 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049807 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049811 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049813 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049816 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049818 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049821 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049824 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049826 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049829 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049832 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049834 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049836 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049839 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.052649 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049842 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049844 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049847 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049849 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049853 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049856 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049859 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049861 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049863 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049866 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049869 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049872 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049874 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049876 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049879 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049881 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049884 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049886 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049889 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.053237 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049892 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049895 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049899 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049902 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049904 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049907 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049909 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049913 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049917 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049920 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049923 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049926 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049928 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049931 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049934 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049936 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049939 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.049942 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050370 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050376 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.053880 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050379 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050382 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050386 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050388 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050391 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050394 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050396 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050399 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050401 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050404 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050407 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050409 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050412 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050414 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050418 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050421 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050423 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050426 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050429 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.054402 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050431 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050435 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050439 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050441 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050444 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050447 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050450 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050453 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050456 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050459 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050461 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050464 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050467 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050470 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050472 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050475 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050477 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050480 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050483 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.054881 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050485 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050487 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050490 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050493 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050495 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050497 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050500 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050503 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050505 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050509 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050511 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050514 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050516 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050519 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050521 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050524 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050526 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050529 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050531 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050534 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.055363 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050536 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050539 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050541 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050544 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050547 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050549 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050552 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050555 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050557 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050559 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050562 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050564 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050568 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050573 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050577 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050581 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050584 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050587 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050589 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.055852 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050592 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050595 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050598 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050601 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050603 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050606 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050608 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050611 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050613 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050616 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050619 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050621 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050624 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050626 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050629 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050632 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050634 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050637 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050640 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.050642 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050733 2551 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 03:43:05.056384 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050744 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050753 2551 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050759 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050765 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050768 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050772 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050776 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050780 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050782 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050786 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050790 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050793 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050796 2551 flags.go:64] FLAG: --cgroup-root="" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050799 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050802 2551 flags.go:64] FLAG: --client-ca-file="" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050806 2551 flags.go:64] FLAG: --cloud-provider="external" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050809 2551 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050814 2551 flags.go:64] FLAG: --cluster-domain="" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050817 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050820 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050823 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050826 2551 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050835 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 03:43:05.056896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050838 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050841 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050845 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050848 2551 flags.go:64] FLAG: --contention-profiling="false" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050851 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050855 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050858 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050861 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050866 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050869 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050872 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050875 2551 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050878 2551 flags.go:64] FLAG: --enable-server="true" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050881 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050886 2551 flags.go:64] FLAG: --event-burst="100" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050889 2551 flags.go:64] FLAG: --event-qps="50" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050892 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050895 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050898 2551 flags.go:64] FLAG: --eviction-hard="" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050902 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050905 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050908 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050911 2551 flags.go:64] FLAG: --eviction-soft="" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050914 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050917 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 03:43:05.057474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050921 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050924 2551 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050927 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050930 2551 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050934 2551 flags.go:64] FLAG: --feature-gates="" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050938 2551 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050943 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050946 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050949 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050952 2551 flags.go:64] FLAG: --healthz-port="10248" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050956 2551 flags.go:64] FLAG: --help="false" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050959 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050962 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050965 2551 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050968 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050972 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050975 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050978 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050981 2551 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050984 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050987 2551 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050990 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050993 2551 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050996 2551 flags.go:64] FLAG: --kube-reserved="" Jun 05 03:43:05.058142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.050999 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051002 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051005 2551 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051008 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051011 2551 flags.go:64] FLAG: --lock-file="" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051013 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051016 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051019 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051025 2551 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051072 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051147 2551 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051153 2551 flags.go:64] FLAG: --logging-format="text" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051160 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051166 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051174 2551 flags.go:64] FLAG: --manifest-url="" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051179 2551 flags.go:64] FLAG: --manifest-url-header="" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051188 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051193 2551 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051206 2551 flags.go:64] FLAG: --max-pods="110" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051211 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.051217 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053232 2551 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053243 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053248 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053252 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 03:43:05.058771 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053256 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053271 2551 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053275 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053279 2551 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053283 2551 flags.go:64] FLAG: --pod-cidr="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053286 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053292 2551 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053297 2551 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053300 2551 flags.go:64] FLAG: --pods-per-core="0" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053307 2551 flags.go:64] FLAG: --port="10250" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053310 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053314 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-059fead01578a0841" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053318 2551 flags.go:64] FLAG: --qos-reserved="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053402 2551 flags.go:64] FLAG: --read-only-port="10255" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053553 2551 flags.go:64] FLAG: --register-node="true" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053561 2551 flags.go:64] FLAG: --register-with-taints="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053576 2551 flags.go:64] FLAG: --registry-burst="10" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053580 2551 flags.go:64] FLAG: --registry-qps="5" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053584 2551 flags.go:64] FLAG: --reserved-cpus="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053588 2551 flags.go:64] FLAG: --reserved-memory="" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053592 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053595 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053599 2551 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053602 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053605 2551 flags.go:64] FLAG: --runonce="false" Jun 05 03:43:05.059425 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053608 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053612 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053616 2551 flags.go:64] FLAG: --seccomp-default="false" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053619 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053622 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053626 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053629 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053632 2551 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053636 2551 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053639 2551 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053642 2551 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053645 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053649 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053652 2551 flags.go:64] FLAG: --system-cgroups="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053655 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053664 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053668 2551 flags.go:64] FLAG: --tls-cert-file="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053671 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053677 2551 flags.go:64] FLAG: --tls-min-version="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053680 2551 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053683 2551 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053687 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053690 2551 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053693 2551 flags.go:64] FLAG: --v="2" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053698 2551 flags.go:64] FLAG: --version="false" Jun 05 03:43:05.060046 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053702 2551 flags.go:64] FLAG: --vmodule="" Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053706 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.053710 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053837 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053841 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053844 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053847 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053851 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053854 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053857 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053860 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053863 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053866 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053868 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053871 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053874 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053876 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053880 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053883 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053886 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.060697 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053888 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053891 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053894 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053897 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053900 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053902 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053905 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053908 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053911 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053914 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053917 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053919 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053922 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053924 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053927 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053930 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053932 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053937 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053941 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.061262 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053944 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053947 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053950 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053953 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053956 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053958 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053961 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053964 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053967 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053971 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053974 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053978 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053981 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053984 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053987 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053990 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053993 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053995 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.053998 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.061731 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054001 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054004 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054007 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054010 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054012 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054015 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054018 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054021 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054024 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054026 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054029 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054032 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054034 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054037 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054039 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054042 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054045 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054047 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054049 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.062220 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054053 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054057 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054060 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054063 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054066 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054068 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054071 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054074 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054077 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054079 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054082 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054084 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054087 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054090 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054093 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054095 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054098 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054100 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054116 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054118 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.062680 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054121 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054124 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054126 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054129 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.054132 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.054902 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.062239 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.062258 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.062278 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.062284 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062341 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062347 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062350 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062353 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.063182 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062356 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062359 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062363 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062368 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062371 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062374 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062377 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062380 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062383 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062386 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062389 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062391 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062394 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062396 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062399 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062402 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062404 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062407 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062409 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062412 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.063540 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062414 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062418 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062420 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062423 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062426 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062429 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062432 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062434 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062438 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062440 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062443 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062446 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062448 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062451 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062453 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062456 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062459 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062462 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062465 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062467 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.064040 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062470 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062472 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062475 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062478 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062480 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062482 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062485 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062488 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062490 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062493 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062495 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062498 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062500 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062503 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062506 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062508 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062511 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062514 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062517 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062519 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.064552 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062522 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062524 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062527 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062529 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062532 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062535 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062537 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062540 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062543 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062545 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062549 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062551 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062554 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062556 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062559 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062561 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062564 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062566 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062569 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062572 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.065058 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062574 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062576 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062579 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062581 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062584 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062587 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062589 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062593 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062597 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062602 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062605 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062608 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062611 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062614 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.065669 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062616 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.062621 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062742 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062746 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062749 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062753 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062756 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062759 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062761 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062765 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062768 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062771 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062774 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062776 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062779 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:05.066010 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062782 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062784 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062786 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062789 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062792 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062794 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062797 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062799 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062802 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062804 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062807 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062809 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062812 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062815 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062819 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062822 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062825 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062828 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062831 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:05.066384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062834 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062837 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062839 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062843 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062846 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062849 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062853 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062856 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062859 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062862 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062865 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062867 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062870 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062873 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062876 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062878 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062881 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062883 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062886 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:05.066853 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062888 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062890 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062893 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062896 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062898 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062901 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062903 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062906 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062909 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062912 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062914 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062917 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062919 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062922 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062924 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062927 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062929 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062932 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062934 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062937 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:05.067321 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062939 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062942 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062945 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062947 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062950 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062952 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062955 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062957 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062960 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062962 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062965 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062967 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062970 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062972 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062975 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062977 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062980 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062983 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062986 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062989 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:05.067804 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062992 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062994 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.062997 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.063000 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.063003 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.063007 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.063010 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:05.063013 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.063018 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.063164 2551 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 03:43:05.068322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.067479 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 03:43:05.069282 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.069268 2551 server.go:1019] "Starting client certificate rotation" Jun 05 03:43:05.069388 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.069370 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:43:05.069448 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.069438 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:43:05.072849 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.072834 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:43:05.075725 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.075707 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:43:05.089457 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.089427 2551 log.go:25] "Validated CRI v1 runtime API" Jun 05 03:43:05.092544 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.092528 2551 log.go:25] "Validated CRI v1 image API" Jun 05 03:43:05.093349 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.093329 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 03:43:05.096528 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.096510 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:43:05.099622 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.099602 2551 fs.go:135] Filesystem UUIDs: map[469887b0-bceb-4762-94b3-c7244cf4a481:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f985e44b-2e29-4af1-b7dc-3c81ae45cdb3:/dev/nvme0n1p3] Jun 05 03:43:05.099679 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.099622 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 03:43:05.105092 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.104976 2551 manager.go:216] Machine: {Timestamp:2026-06-05 03:43:05.103431176 +0000 UTC m=+0.378804237 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086037 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c6cce80d9a606ab0e289876cac37 SystemUUID:ec24c6cc-e80d-9a60-6ab0-e289876cac37 BootID:db93aabf-fc03-41ee-a034-accb2a95afb0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7d:d6:e6:c1:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7d:d6:e6:c1:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:ed:63:6c:69:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 03:43:05.105092 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.105084 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 03:43:05.105212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.105185 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 03:43:05.108769 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.108733 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 03:43:05.108908 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.108771 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 03:43:05.109684 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.109673 2551 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 03:43:05.109728 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.109686 2551 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 03:43:05.109728 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.109694 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:43:05.109728 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.109711 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:43:05.110997 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.110985 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 03:43:05.115518 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115504 2551 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:43:05.115644 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115634 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 03:43:05.115681 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115668 2551 kubelet.go:486] "Attempting to sync node with API server" Jun 05 03:43:05.115681 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115678 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 03:43:05.115739 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115693 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 03:43:05.115739 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115704 2551 kubelet.go:398] "Adding apiserver pod source" Jun 05 03:43:05.115739 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.115713 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 03:43:05.116195 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.116176 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:43:05.116240 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.116201 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:43:05.118654 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.118637 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 03:43:05.120504 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.120488 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 03:43:05.120565 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.120519 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 03:43:05.121903 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121891 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121908 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121914 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121920 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121929 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121934 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121942 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121948 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121954 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 03:43:05.121957 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121960 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 03:43:05.122212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121970 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 03:43:05.122212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.121975 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 03:43:05.122860 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.122845 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 03:43:05.122860 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.122856 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 03:43:05.125759 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.125735 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 03:43:05.125862 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.125799 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 03:43:05.125862 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.125819 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 03:43:05.126595 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.126581 2551 server.go:1268] "Started kubelet" Jun 05 03:43:05.126717 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.126687 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 03:43:05.127000 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.126679 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 03:43:05.127082 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.127036 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 03:43:05.127792 ip-10-0-139-39 systemd[1]: Started Kubernetes Kubelet. Jun 05 03:43:05.128928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.128915 2551 server.go:310] "Adding debug handlers to kubelet server" Jun 05 03:43:05.129290 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.129274 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 03:43:05.133812 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.132559 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-39.ec2.internal.18b612726085a792 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-39.ec2.internal,UID:ip-10-0-139-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-39.ec2.internal,},FirstTimestamp:2026-06-05 03:43:05.12655349 +0000 UTC m=+0.401926552,LastTimestamp:2026-06-05 03:43:05.12655349 +0000 UTC m=+0.401926552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-39.ec2.internal,}" Jun 05 03:43:05.135362 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.135342 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 03:43:05.136505 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.136488 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 03:43:05.136591 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.136503 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 03:43:05.136591 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.136557 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.137260 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137242 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 03:43:05.137260 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137244 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 03:43:05.137424 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137271 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 03:43:05.137477 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137455 2551 factory.go:55] Registering systemd factory Jun 05 03:43:05.137477 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137460 2551 reconstruct.go:97] "Volume reconstruction finished" Jun 05 03:43:05.137477 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137469 2551 reconciler.go:29] "Reconciler: start to sync state" Jun 05 03:43:05.137477 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137471 2551 factory.go:223] Registration of the systemd container factory successfully Jun 05 03:43:05.137680 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137664 2551 factory.go:153] Registering CRI-O factory Jun 05 03:43:05.137720 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137685 2551 factory.go:223] Registration of the crio container factory successfully Jun 05 03:43:05.137762 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137740 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 03:43:05.137808 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137765 2551 factory.go:103] Registering Raw factory Jun 05 03:43:05.137808 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.137778 2551 manager.go:1196] Started watching for new ooms in manager Jun 05 03:43:05.138384 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.138188 2551 manager.go:349] Starting recovery of all containers Jun 05 03:43:05.138713 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.138682 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 03:43:05.138835 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.138792 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 03:43:05.148396 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.148370 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z6r6t" Jun 05 03:43:05.149069 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.149052 2551 manager.go:354] Recovery completed Jun 05 03:43:05.153770 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.153757 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.156037 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.156016 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z6r6t" Jun 05 03:43:05.156746 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.156726 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.156850 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.156766 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.156850 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.156780 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.158676 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.158660 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 03:43:05.158676 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.158674 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 03:43:05.158784 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.158690 2551 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:43:05.159019 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.159007 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.159870 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.159854 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.159928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.159885 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.159928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.159912 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.160806 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.160795 2551 policy_none.go:49] "None policy: Start" Jun 05 03:43:05.160848 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.160811 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 03:43:05.160848 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.160821 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 03:43:05.162567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.162552 2551 policy_none.go:47] "Start" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.200219 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.201366 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.201398 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.201421 2551 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.201453 2551 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.203580 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206028 2551 manager.go:337] "Starting Device Plugin manager" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.206176 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206192 2551 server.go:87] "Starting device plugin registration server" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206494 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206505 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206592 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206672 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.206681 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.207203 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 03:43:05.211013 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.207245 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.302655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.301737 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal"] Jun 05 03:43:05.302759 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.302662 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.303713 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.303690 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.303830 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.303732 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.303830 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.303747 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.306951 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.306936 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.307258 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307245 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.307414 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307402 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.307450 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307436 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.307714 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307701 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.307755 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307726 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.307755 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307735 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.307812 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.307756 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.308672 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308653 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.308749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308682 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.308749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308696 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.308749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308707 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.308749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308724 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.308749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.308733 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.310978 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.310959 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.311069 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.310992 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:05.311809 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.311794 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:05.311875 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.311819 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:05.311875 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.311830 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:05.315949 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.315934 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.316038 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.315959 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-39.ec2.internal\": node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.336963 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.336932 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.338051 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.338026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.338171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.338057 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.338171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.338074 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.338171 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.338085 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-39.ec2.internal\" not found" node="ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.342734 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.342714 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-39.ec2.internal\" not found" node="ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.437376 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.437342 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.438486 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438467 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.438572 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438499 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.438572 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438525 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.438655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438578 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.438655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438609 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.438655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.438578 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.537684 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.537652 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.638382 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.638306 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.644581 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.644558 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.649410 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:05.649163 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:05.738861 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.738818 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.839286 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.839249 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:05.939780 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:05.939705 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.040201 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:06.040165 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.068429 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.068402 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 03:43:06.069073 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.068595 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 03:43:06.140807 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:06.140773 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.161961 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.161907 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 03:38:05 +0000 UTC" deadline="2027-11-17 16:45:21.133291309 +0000 UTC" Jun 05 03:43:06.161961 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.161956 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12733h2m14.97133875s" Jun 05 03:43:06.222280 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.222261 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:06.233932 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:06.233902 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7eb7d4f442858d5fa850411397de67.slice/crio-a0bf350f8f04bab1c18f34b7e4703ea8e62aec70acf32394edd1841dc333d617 WatchSource:0}: Error finding container a0bf350f8f04bab1c18f34b7e4703ea8e62aec70acf32394edd1841dc333d617: Status 404 returned error can't find the container with id a0bf350f8f04bab1c18f34b7e4703ea8e62aec70acf32394edd1841dc333d617 Jun 05 03:43:06.234533 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:06.234515 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646afa05f03c2e82f5695adce95c6bad.slice/crio-0ef9b556f6161313adfb1a4ff05ea8f577206830bee86ee32f20eeb1c89d86b4 WatchSource:0}: Error finding container 0ef9b556f6161313adfb1a4ff05ea8f577206830bee86ee32f20eeb1c89d86b4: Status 404 returned error can't find the container with id 0ef9b556f6161313adfb1a4ff05ea8f577206830bee86ee32f20eeb1c89d86b4 Jun 05 03:43:06.240867 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:06.240846 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.241589 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.241568 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:43:06.297808 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.297780 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:06.341436 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:06.341405 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.441933 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:06.441901 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 03:43:06.515961 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.515936 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:06.537253 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.537219 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 03:43:06.549922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.549895 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:43:06.551152 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.551133 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 03:43:06.560205 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.560178 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:43:06.991482 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:06.991399 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:07.117586 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.117462 2551 apiserver.go:52] "Watching apiserver" Jun 05 03:43:07.128120 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.128071 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 03:43:07.128585 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.128551 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xn2vb","openshift-cluster-node-tuning-operator/tuned-bhml8","openshift-multus/multus-additional-cni-plugins-xpkjn","openshift-multus/multus-ntqzv","openshift-network-operator/iptables-alerter-gwnj5","kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7","openshift-dns/node-resolver-d5dxn","openshift-image-registry/node-ca-mbf7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal","openshift-multus/network-metrics-daemon-4v49z","openshift-network-diagnostics/network-check-target-5b7vt","openshift-ovn-kubernetes/ovnkube-node-rdw8q","kube-system/global-pull-secret-syncer-98g5d"] Jun 05 03:43:07.131143 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.131119 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.133358 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.133337 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.135268 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.135251 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.135453 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.135371 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 03:43:07.135453 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.135439 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.135660 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.135643 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nm2w2\"" Jun 05 03:43:07.139529 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.137178 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 03:43:07.139529 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.137501 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.139529 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.137571 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 03:43:07.139529 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.138076 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c87mw\"" Jun 05 03:43:07.139529 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.138273 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 03:43:07.140132 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.140061 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.141767 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.140920 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 03:43:07.141767 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.141139 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 03:43:07.141767 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.141446 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.143031 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.142805 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.143914 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.143891 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 03:43:07.144573 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.144551 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.144743 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.144577 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 03:43:07.144743 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.144642 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 03:43:07.144867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.144766 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.144867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.144809 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7zcc7\"" Jun 05 03:43:07.145091 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.145074 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.145190 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.145154 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 03:43:07.145245 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.145197 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w7np5\"" Jun 05 03:43:07.147389 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147364 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cnibin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147490 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147403 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-os-release\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147490 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147427 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cni-binary-copy\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147490 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147457 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d8b275f-057f-49a2-83ce-50d011abef47-ovn-node-metrics-cert\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.147490 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147480 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-bin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-etc-kubernetes\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147526 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-systemd-units\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-slash\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147569 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147596 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-netns\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147620 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7sz\" (UniqueName: \"kubernetes.io/projected/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-kube-api-access-fk7sz\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147641 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.147697 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147687 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-node-log\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147710 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-log-socket\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147753 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147751 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-netd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147791 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147777 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147813 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-script-lib\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147840 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-os-release\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147863 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147922 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-netns\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147945 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.147988 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-system-cni-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148010 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-cnibin\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148067 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9c99j\"" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148119 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148151 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-system-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148176 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-socket-dir-parent\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148200 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-k8s-cni-cncf-io\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148223 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148223 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-etc-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.148308 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148362 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148405 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-hostroot\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148436 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-conf-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148462 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-env-overrides\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148550 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-device-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.148642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148614 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-var-lib-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148640 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8dk\" (UniqueName: \"kubernetes.io/projected/da7b3e0b-25a4-465c-bb29-e75e66c61417-kube-api-access-qg8dk\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148667 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-multus\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148707 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2znqs\" (UniqueName: \"kubernetes.io/projected/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kube-api-access-2znqs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148764 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-kubelet\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-systemd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148811 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-bin\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148834 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-kubelet\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148854 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-daemon-config\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148876 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-multus-certs\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148898 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148920 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-ovn\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148945 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148971 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-config\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.149336 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.148993 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lpgw\" (UniqueName: \"kubernetes.io/projected/9d8b275f-057f-49a2-83ce-50d011abef47-kube-api-access-7lpgw\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.150604 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.150579 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:43:07.150870 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.150843 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.153411 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.153386 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 03:43:07.153636 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.153617 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.153743 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.153386 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m27lp\"" Jun 05 03:43:07.154454 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.153386 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.154454 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.154033 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.156689 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.156671 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.157229 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.157208 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 03:43:07.157341 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.157247 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dt5sx\"" Jun 05 03:43:07.157341 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.157219 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 03:43:07.159076 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.159054 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-flnct\"" Jun 05 03:43:07.159380 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.159336 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.159574 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.159555 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.159767 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.159745 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.161656 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.161606 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 03:43:07.161758 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.161696 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 03:43:07.161852 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.161823 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gqx7m\"" Jun 05 03:43:07.162068 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.162047 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.162181 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.162154 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:07.164567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.164495 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:07.164672 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.164562 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:07.206096 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.206046 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerStarted","Data":"0ef9b556f6161313adfb1a4ff05ea8f577206830bee86ee32f20eeb1c89d86b4"} Jun 05 03:43:07.207063 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.207040 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" event={"ID":"cd7eb7d4f442858d5fa850411397de67","Type":"ContainerStarted","Data":"a0bf350f8f04bab1c18f34b7e4703ea8e62aec70acf32394edd1841dc333d617"} Jun 05 03:43:07.238848 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.238820 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 03:43:07.249567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249481 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.249567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249534 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-hostroot\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.249567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249563 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-conf\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249567 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249591 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-tmp\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249616 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-dbus\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249618 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-hostroot\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44xrm\" (UniqueName: \"kubernetes.io/projected/0d566b68-2109-4850-a2ab-ce18c50a0ce5-kube-api-access-44xrm\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249668 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-env-overrides\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249695 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249717 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.249818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249786 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249829 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8dk\" (UniqueName: \"kubernetes.io/projected/da7b3e0b-25a4-465c-bb29-e75e66c61417-kube-api-access-qg8dk\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249862 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249863 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaec1526-4249-4b5b-84f4-7385a75ab5bb-tmp-dir\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.249986 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znqs\" (UniqueName: \"kubernetes.io/projected/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kube-api-access-2znqs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-bin\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250087 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-systemd\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250128 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/443e7341-adde-4111-900c-6802190e5123-host-slash\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250153 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e28fdd-56ca-4754-bb13-cad9b1205068-host\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250163 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-bin\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250180 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-ovn\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250202 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lpgw\" (UniqueName: \"kubernetes.io/projected/9d8b275f-057f-49a2-83ce-50d011abef47-kube-api-access-7lpgw\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250217 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cnibin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250231 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-os-release\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-env-overrides\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250255 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cni-binary-copy\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250258 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-ovn\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.250301 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250284 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-kubernetes\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250314 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-run\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250333 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-os-release\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250337 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cnibin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250334 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-sys\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250395 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d8b275f-057f-49a2-83ce-50d011abef47-ovn-node-metrics-cert\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250455 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-var-lib-kubelet\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250488 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-kubelet-config\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250512 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e28fdd-56ca-4754-bb13-cad9b1205068-serviceca\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250546 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-netns\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250608 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-netns\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250618 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7sz\" (UniqueName: \"kubernetes.io/projected/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-kube-api-access-fk7sz\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250649 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkp5\" (UniqueName: \"kubernetes.io/projected/597e9e26-d014-47a4-8c89-d0a9497edecd-kube-api-access-4qkp5\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250677 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbnbd\" (UniqueName: \"kubernetes.io/projected/eaec1526-4249-4b5b-84f4-7385a75ab5bb-kube-api-access-fbnbd\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250696 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-node-log\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250736 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-log-socket\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250750 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250764 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-netd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250788 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-script-lib\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250812 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-system-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250837 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-netns\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250841 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-node-log\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250862 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250886 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-cnibin\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250814 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-log-socket\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250926 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250928 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-cnibin\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250946 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-cni-binary-copy\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250956 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-cni-netd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250961 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-socket-dir-parent\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250997 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-run-netns\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.250999 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-conf-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251008 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-socket-dir-parent\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251034 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-etc-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251057 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-conf-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251122 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.251867 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251124 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-etc-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251149 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-system-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251174 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/443e7341-adde-4111-900c-6802190e5123-iptables-alerter-script\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251183 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-cni-dir\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251215 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-kubelet\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251252 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-multus-certs\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251271 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-kubelet\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251302 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-device-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251333 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-var-lib-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251342 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-script-lib\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251360 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-multus\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251364 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-device-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251377 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-var-lib-openvswitch\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251397 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-multus\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251401 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-modprobe-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251435 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251454 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-kubelet\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.252607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251401 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-multus-certs\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251474 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-systemd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251502 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-run-systemd\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251514 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-daemon-config\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251517 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251531 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-kubelet\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251558 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-lib-modules\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251582 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251608 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251646 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-config\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251670 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-bin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251693 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-etc-kubernetes\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251702 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251715 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlhf\" (UniqueName: \"kubernetes.io/projected/443e7341-adde-4111-900c-6802190e5123-kube-api-access-6wlhf\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251743 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysconfig\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251802 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.253272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251832 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-host\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251893 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-systemd-units\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251941 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-slash\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251968 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.251994 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaec1526-4249-4b5b-84f4-7385a75ab5bb-hosts-file\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252022 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-multus-daemon-config\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252036 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252062 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252101 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-systemd-units\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252120 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-os-release\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252146 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252167 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-var-lib-cni-bin\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252201 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d8b275f-057f-49a2-83ce-50d011abef47-host-slash\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252199 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d8b275f-057f-49a2-83ce-50d011abef47-ovnkube-config\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252201 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252236 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-etc-kubernetes\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.253838 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252237 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-k8s-cni-cncf-io\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252272 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-host-run-k8s-cni-cncf-io\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9fdc225-aea5-45e8-99d8-7059582f3c70-konnectivity-ca\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-tuned\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252330 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc2dj\" (UniqueName: \"kubernetes.io/projected/43e28fdd-56ca-4754-bb13-cad9b1205068-kube-api-access-xc2dj\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252357 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-system-cni-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252400 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252428 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9fdc225-aea5-45e8-99d8-7059582f3c70-agent-certs\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252457 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252569 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-system-cni-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252770 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252780 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252845 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.252855 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da7b3e0b-25a4-465c-bb29-e75e66c61417-os-release\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.253171 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da7b3e0b-25a4-465c-bb29-e75e66c61417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.254607 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.254290 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d8b275f-057f-49a2-83ce-50d011abef47-ovn-node-metrics-cert\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.258665 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.258604 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8dk\" (UniqueName: \"kubernetes.io/projected/da7b3e0b-25a4-465c-bb29-e75e66c61417-kube-api-access-qg8dk\") pod \"multus-additional-cni-plugins-xpkjn\" (UID: \"da7b3e0b-25a4-465c-bb29-e75e66c61417\") " pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.259247 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.259229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7sz\" (UniqueName: \"kubernetes.io/projected/31489459-370e-4fdb-b6c3-ed1a9bbe3cf4-kube-api-access-fk7sz\") pod \"multus-ntqzv\" (UID: \"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4\") " pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.259518 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.259495 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2znqs\" (UniqueName: \"kubernetes.io/projected/99b49b63-2471-41ad-b4e2-40d3ca6a9df2-kube-api-access-2znqs\") pod \"aws-ebs-csi-driver-node-bbzn7\" (UID: \"99b49b63-2471-41ad-b4e2-40d3ca6a9df2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.259633 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.259613 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lpgw\" (UniqueName: \"kubernetes.io/projected/9d8b275f-057f-49a2-83ce-50d011abef47-kube-api-access-7lpgw\") pod \"ovnkube-node-rdw8q\" (UID: \"9d8b275f-057f-49a2-83ce-50d011abef47\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.271417 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.271390 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlkkb" Jun 05 03:43:07.276682 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.276663 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlkkb" Jun 05 03:43:07.353689 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353649 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-modprobe-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353697 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-lib-modules\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353727 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlhf\" (UniqueName: \"kubernetes.io/projected/443e7341-adde-4111-900c-6802190e5123-kube-api-access-6wlhf\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353754 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysconfig\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353777 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353839 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-modprobe-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.353866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353845 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-host\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353888 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353912 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-d\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353914 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-lib-modules\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353917 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysconfig\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353921 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaec1526-4249-4b5b-84f4-7385a75ab5bb-hosts-file\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353976 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.353985 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.353892 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-host\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354007 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9fdc225-aea5-45e8-99d8-7059582f3c70-konnectivity-ca\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354033 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-tuned\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354043 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaec1526-4249-4b5b-84f4-7385a75ab5bb-hosts-file\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.354065 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:07.854040898 +0000 UTC m=+3.129413970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354081 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc2dj\" (UniqueName: \"kubernetes.io/projected/43e28fdd-56ca-4754-bb13-cad9b1205068-kube-api-access-xc2dj\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.354100 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354128 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9fdc225-aea5-45e8-99d8-7059582f3c70-agent-certs\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354152 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:07.354184 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.354182 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:07.854163374 +0000 UTC m=+3.129536451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354203 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-conf\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354233 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-tmp\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354256 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-dbus\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354282 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44xrm\" (UniqueName: \"kubernetes.io/projected/0d566b68-2109-4850-a2ab-ce18c50a0ce5-kube-api-access-44xrm\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354312 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaec1526-4249-4b5b-84f4-7385a75ab5bb-tmp-dir\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354338 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-systemd\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354362 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/443e7341-adde-4111-900c-6802190e5123-host-slash\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354389 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e28fdd-56ca-4754-bb13-cad9b1205068-host\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-kubernetes\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354439 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-run\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354462 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-sys\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354486 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-var-lib-kubelet\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354510 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-kubelet-config\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354533 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e28fdd-56ca-4754-bb13-cad9b1205068-serviceca\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354558 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkp5\" (UniqueName: \"kubernetes.io/projected/597e9e26-d014-47a4-8c89-d0a9497edecd-kube-api-access-4qkp5\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354565 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-dbus\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354619 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9fdc225-aea5-45e8-99d8-7059582f3c70-konnectivity-ca\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.355035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354581 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbnbd\" (UniqueName: \"kubernetes.io/projected/eaec1526-4249-4b5b-84f4-7385a75ab5bb-kube-api-access-fbnbd\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354679 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaec1526-4249-4b5b-84f4-7385a75ab5bb-tmp-dir\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354692 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/443e7341-adde-4111-900c-6802190e5123-iptables-alerter-script\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354743 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-run\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354784 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea9abade-2a74-44f3-8341-ab4b830c5ce4-kubelet-config\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354789 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-systemd\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/443e7341-adde-4111-900c-6802190e5123-host-slash\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354844 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-sys\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354863 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e28fdd-56ca-4754-bb13-cad9b1205068-host\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354887 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-var-lib-kubelet\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354417 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-sysctl-conf\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.354910 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-kubernetes\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.355218 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e28fdd-56ca-4754-bb13-cad9b1205068-serviceca\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.355777 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.355301 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/443e7341-adde-4111-900c-6802190e5123-iptables-alerter-script\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.356987 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.356959 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-tmp\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.357099 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.357021 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/597e9e26-d014-47a4-8c89-d0a9497edecd-etc-tuned\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.357244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.357225 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9fdc225-aea5-45e8-99d8-7059582f3c70-agent-certs\") pod \"konnectivity-agent-xn2vb\" (UID: \"e9fdc225-aea5-45e8-99d8-7059582f3c70\") " pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.366846 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.366822 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:07.366846 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.366847 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:07.367044 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.366861 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:07.367044 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.366937 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:07.86691687 +0000 UTC m=+3.142289934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:07.367463 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.367399 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbnbd\" (UniqueName: \"kubernetes.io/projected/eaec1526-4249-4b5b-84f4-7385a75ab5bb-kube-api-access-fbnbd\") pod \"node-resolver-d5dxn\" (UID: \"eaec1526-4249-4b5b-84f4-7385a75ab5bb\") " pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.367558 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.367481 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc2dj\" (UniqueName: \"kubernetes.io/projected/43e28fdd-56ca-4754-bb13-cad9b1205068-kube-api-access-xc2dj\") pod \"node-ca-mbf7r\" (UID: \"43e28fdd-56ca-4754-bb13-cad9b1205068\") " pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.367558 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.367539 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlhf\" (UniqueName: \"kubernetes.io/projected/443e7341-adde-4111-900c-6802190e5123-kube-api-access-6wlhf\") pod \"iptables-alerter-gwnj5\" (UID: \"443e7341-adde-4111-900c-6802190e5123\") " pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.368255 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.368238 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkp5\" (UniqueName: \"kubernetes.io/projected/597e9e26-d014-47a4-8c89-d0a9497edecd-kube-api-access-4qkp5\") pod \"tuned-bhml8\" (UID: \"597e9e26-d014-47a4-8c89-d0a9497edecd\") " pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.368981 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.368962 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44xrm\" (UniqueName: \"kubernetes.io/projected/0d566b68-2109-4850-a2ab-ce18c50a0ce5-kube-api-access-44xrm\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.448544 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.448510 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" Jun 05 03:43:07.456056 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.455800 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:07.465736 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.465710 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwnj5" Jun 05 03:43:07.470449 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.470428 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" Jun 05 03:43:07.482157 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.482132 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ntqzv" Jun 05 03:43:07.486703 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.486683 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mbf7r" Jun 05 03:43:07.494193 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.494171 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:07.500986 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.500945 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bhml8" Jun 05 03:43:07.504623 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.504599 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5dxn" Jun 05 03:43:07.858510 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.858474 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:07.858510 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.858513 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:07.858732 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.858649 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:07.858732 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.858702 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:07.858732 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.858726 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:08.858705788 +0000 UTC m=+4.134078850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:07.858938 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.858748 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:08.858736761 +0000 UTC m=+4.134109813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:07.958967 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:07.958931 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:07.959150 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.959081 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:07.959150 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.959115 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:07.959150 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.959126 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:07.959302 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:07.959185 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:08.959163528 +0000 UTC m=+4.234536575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:08.193399 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.193363 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b49b63_2471_41ad_b4e2_40d3ca6a9df2.slice/crio-ee91b51f75bb3b854bb7fb014aefbcbbfd94ffa6154ee9d1cd7c0322f011fe75 WatchSource:0}: Error finding container ee91b51f75bb3b854bb7fb014aefbcbbfd94ffa6154ee9d1cd7c0322f011fe75: Status 404 returned error can't find the container with id ee91b51f75bb3b854bb7fb014aefbcbbfd94ffa6154ee9d1cd7c0322f011fe75 Jun 05 03:43:08.199967 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.199935 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8b275f_057f_49a2_83ce_50d011abef47.slice/crio-0f5983b096ae23f47f7f5976e7c3556af66b26e8d243a2ed96f8c80045d40ddf WatchSource:0}: Error finding container 0f5983b096ae23f47f7f5976e7c3556af66b26e8d243a2ed96f8c80045d40ddf: Status 404 returned error can't find the container with id 0f5983b096ae23f47f7f5976e7c3556af66b26e8d243a2ed96f8c80045d40ddf Jun 05 03:43:08.200601 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.200582 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31489459_370e_4fdb_b6c3_ed1a9bbe3cf4.slice/crio-65ab687139ce818e99b91c6bfb775663fee7ffe5e06c714867f8e1a386829eb3 WatchSource:0}: Error finding container 65ab687139ce818e99b91c6bfb775663fee7ffe5e06c714867f8e1a386829eb3: Status 404 returned error can't find the container with id 65ab687139ce818e99b91c6bfb775663fee7ffe5e06c714867f8e1a386829eb3 Jun 05 03:43:08.201466 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.201444 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e28fdd_56ca_4754_bb13_cad9b1205068.slice/crio-fabdebfd0606980825868c9d895f9fabbd84b54685c862296eea7db130f67b50 WatchSource:0}: Error finding container fabdebfd0606980825868c9d895f9fabbd84b54685c862296eea7db130f67b50: Status 404 returned error can't find the container with id fabdebfd0606980825868c9d895f9fabbd84b54685c862296eea7db130f67b50 Jun 05 03:43:08.202293 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.202273 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fdc225_aea5_45e8_99d8_7059582f3c70.slice/crio-529c540f2530781c5903a0a2e8b07e283a6791eef57b9c47311895621a2c5b07 WatchSource:0}: Error finding container 529c540f2530781c5903a0a2e8b07e283a6791eef57b9c47311895621a2c5b07: Status 404 returned error can't find the container with id 529c540f2530781c5903a0a2e8b07e283a6791eef57b9c47311895621a2c5b07 Jun 05 03:43:08.203441 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.203414 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7b3e0b_25a4_465c_bb29_e75e66c61417.slice/crio-6c50eb4fb79e3fc60381af50ac000d5ec4a35f2103797f982881f60c539ca9ac WatchSource:0}: Error finding container 6c50eb4fb79e3fc60381af50ac000d5ec4a35f2103797f982881f60c539ca9ac: Status 404 returned error can't find the container with id 6c50eb4fb79e3fc60381af50ac000d5ec4a35f2103797f982881f60c539ca9ac Jun 05 03:43:08.205524 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.205503 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443e7341_adde_4111_900c_6802190e5123.slice/crio-f77f606a2a7d3c044b85c6537cbea557502f92984f03e0f76a9b2ff597d072db WatchSource:0}: Error finding container f77f606a2a7d3c044b85c6537cbea557502f92984f03e0f76a9b2ff597d072db: Status 404 returned error can't find the container with id f77f606a2a7d3c044b85c6537cbea557502f92984f03e0f76a9b2ff597d072db Jun 05 03:43:08.208016 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.207995 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaec1526_4249_4b5b_84f4_7385a75ab5bb.slice/crio-0988899ec587e25b8ddbeba36bb6bb050cfea9e64e8160a4360239fed7ce9a59 WatchSource:0}: Error finding container 0988899ec587e25b8ddbeba36bb6bb050cfea9e64e8160a4360239fed7ce9a59: Status 404 returned error can't find the container with id 0988899ec587e25b8ddbeba36bb6bb050cfea9e64e8160a4360239fed7ce9a59 Jun 05 03:43:08.208903 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:08.208880 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597e9e26_d014_47a4_8c89_d0a9497edecd.slice/crio-c4921d8cd92fcfcfd925d9c448cabf65d63cb13ccfbbbcc856a66d21c0228493 WatchSource:0}: Error finding container c4921d8cd92fcfcfd925d9c448cabf65d63cb13ccfbbbcc856a66d21c0228493: Status 404 returned error can't find the container with id c4921d8cd92fcfcfd925d9c448cabf65d63cb13ccfbbbcc856a66d21c0228493 Jun 05 03:43:08.209672 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.209552 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" event={"ID":"99b49b63-2471-41ad-b4e2-40d3ca6a9df2","Type":"ContainerStarted","Data":"ee91b51f75bb3b854bb7fb014aefbcbbfd94ffa6154ee9d1cd7c0322f011fe75"} Jun 05 03:43:08.211309 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.211285 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerStarted","Data":"6c50eb4fb79e3fc60381af50ac000d5ec4a35f2103797f982881f60c539ca9ac"} Jun 05 03:43:08.212681 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.212649 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mbf7r" event={"ID":"43e28fdd-56ca-4754-bb13-cad9b1205068","Type":"ContainerStarted","Data":"fabdebfd0606980825868c9d895f9fabbd84b54685c862296eea7db130f67b50"} Jun 05 03:43:08.213909 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.213887 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xn2vb" event={"ID":"e9fdc225-aea5-45e8-99d8-7059582f3c70","Type":"ContainerStarted","Data":"529c540f2530781c5903a0a2e8b07e283a6791eef57b9c47311895621a2c5b07"} Jun 05 03:43:08.215212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.215187 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"0f5983b096ae23f47f7f5976e7c3556af66b26e8d243a2ed96f8c80045d40ddf"} Jun 05 03:43:08.216734 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.216619 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwnj5" event={"ID":"443e7341-adde-4111-900c-6802190e5123","Type":"ContainerStarted","Data":"f77f606a2a7d3c044b85c6537cbea557502f92984f03e0f76a9b2ff597d072db"} Jun 05 03:43:08.218081 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.218060 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ntqzv" event={"ID":"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4","Type":"ContainerStarted","Data":"65ab687139ce818e99b91c6bfb775663fee7ffe5e06c714867f8e1a386829eb3"} Jun 05 03:43:08.280712 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.280674 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:38:07 +0000 UTC" deadline="2028-02-12 06:36:31.128110248 +0000 UTC" Jun 05 03:43:08.280712 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.280710 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14810h53m22.84740505s" Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.866186 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.866245 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.866426 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.866436 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.866488 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:10.866469941 +0000 UTC m=+6.141843003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:08.866617 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.866543 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:10.866532651 +0000 UTC m=+6.141905705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:08.967082 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:08.967041 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:08.967312 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.967293 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:08.967381 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.967318 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:08.967381 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.967331 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:08.967477 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:08.967389 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:10.967372409 +0000 UTC m=+6.242745481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:09.202989 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.202075 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:09.202989 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:09.202237 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:09.202989 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.202699 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:09.202989 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:09.202798 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:09.203922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.203775 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:09.203922 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:09.203871 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:09.234236 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.234200 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bhml8" event={"ID":"597e9e26-d014-47a4-8c89-d0a9497edecd","Type":"ContainerStarted","Data":"c4921d8cd92fcfcfd925d9c448cabf65d63cb13ccfbbbcc856a66d21c0228493"} Jun 05 03:43:09.257663 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.257625 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5dxn" event={"ID":"eaec1526-4249-4b5b-84f4-7385a75ab5bb","Type":"ContainerStarted","Data":"0988899ec587e25b8ddbeba36bb6bb050cfea9e64e8160a4360239fed7ce9a59"} Jun 05 03:43:09.274885 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.274558 2551 generic.go:356] "Generic (PLEG): container finished" podID="646afa05f03c2e82f5695adce95c6bad" containerID="936f9a83a3007c3db7b33c6366d2c957917b51717dedd7b528f7192b3ce17838" exitCode=0 Jun 05 03:43:09.274885 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.274779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerDied","Data":"936f9a83a3007c3db7b33c6366d2c957917b51717dedd7b528f7192b3ce17838"} Jun 05 03:43:09.282403 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.282279 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:38:07 +0000 UTC" deadline="2028-01-28 11:54:24.070631028 +0000 UTC" Jun 05 03:43:09.282403 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.282331 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14456h11m14.788304128s" Jun 05 03:43:09.285327 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.284808 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" event={"ID":"cd7eb7d4f442858d5fa850411397de67","Type":"ContainerStarted","Data":"54525cadb684acffb47b2cc20b9c33b56213230eb11fd0d44a0640fddf11218f"} Jun 05 03:43:09.304967 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:09.304907 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" podStartSLOduration=3.304884828 podStartE2EDuration="3.304884828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:09.304322788 +0000 UTC m=+4.579695859" watchObservedRunningTime="2026-06-05 03:43:09.304884828 +0000 UTC m=+4.580257899" Jun 05 03:43:10.319013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:10.318978 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerStarted","Data":"a31761e1d88e24e0010c731249473c50f863cbe3805b5b70fa143294834a7957"} Jun 05 03:43:10.881965 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:10.881924 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:10.882220 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:10.881980 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:10.882220 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.882164 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:10.882348 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.882232 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:14.882212075 +0000 UTC m=+10.157585137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:10.882660 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.882615 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:10.882768 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.882666 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:14.882651763 +0000 UTC m=+10.158024825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:10.983325 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:10.983288 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:10.983506 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.983493 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:10.983581 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.983513 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:10.983581 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.983527 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:10.983689 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:10.983588 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:14.983570036 +0000 UTC m=+10.258943091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:11.202611 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:11.202524 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:11.202611 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:11.202560 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:11.202819 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:11.202527 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:11.202819 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:11.202661 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:11.202819 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:11.202756 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:11.202993 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:11.202850 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:13.203908 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:13.203213 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:13.203908 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:13.203344 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:13.203908 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:13.203750 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:13.203908 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:13.203852 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:13.204749 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:13.204608 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:13.204749 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:13.204698 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:14.916454 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:14.916505 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:14.916675 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:14.916739 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:22.916717645 +0000 UTC m=+18.192090708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:14.917148 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:14.917237 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:14.917197 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:22.917179429 +0000 UTC m=+18.192552494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:15.017370 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:15.017330 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:15.017935 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.017536 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:15.017935 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.017569 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:15.017935 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.017584 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:15.017935 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.017646 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:23.017630154 +0000 UTC m=+18.293003225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:15.203654 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:15.203564 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:15.203803 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.203677 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:15.204258 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:15.204019 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:15.204258 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:15.204146 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:15.204258 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.204176 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:15.204258 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:15.204222 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:17.201871 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:17.201835 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:17.202372 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:17.201989 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:17.202372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:17.202031 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:17.202372 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:17.202160 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:17.202372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:17.202219 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:17.202372 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:17.202300 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:19.201737 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:19.201699 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:19.202147 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:19.201699 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:19.202147 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:19.201823 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:19.202147 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:19.201699 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:19.202147 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:19.201877 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:19.202147 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:19.201991 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:21.202400 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:21.202357 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:21.202860 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:21.202361 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:21.202860 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:21.202495 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:21.202860 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:21.202372 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:21.202860 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:21.202556 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:21.202860 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:21.202677 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:22.975676 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:22.975639 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:22.976244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:22.975740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:22.976244 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:22.975829 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:22.976244 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:22.975852 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:22.976244 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:22.975914 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:38.975896299 +0000 UTC m=+34.251269361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:22.976244 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:22.975935 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:38.975924173 +0000 UTC m=+34.251297224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:23.077019 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:23.076982 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:23.077225 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.077137 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:23.077225 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.077161 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:23.077225 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.077175 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.077386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.077235 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:43:39.077217709 +0000 UTC m=+34.352590771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.202088 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:23.202034 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:23.202088 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:23.202072 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:23.202335 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:23.202186 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:23.202335 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.202199 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:23.202335 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.202314 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:23.202473 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:23.202414 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:25.203010 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:25.202973 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:25.203514 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:25.203125 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:25.203514 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:25.203135 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:25.203514 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:25.203270 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:25.203514 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:25.203291 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:25.203514 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:25.203346 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:27.201685 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:27.201648 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:27.202134 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:27.201658 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:27.202134 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:27.201753 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:27.202134 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:27.201847 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:27.202134 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:27.201896 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:27.202134 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:27.201969 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:28.357440 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.357010 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mbf7r" event={"ID":"43e28fdd-56ca-4754-bb13-cad9b1205068","Type":"ContainerStarted","Data":"8f1e3ca878a9deca453e7c222b3de7468a1605bc2272aad34288b7b79bb70a57"} Jun 05 03:43:28.358674 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.358640 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xn2vb" event={"ID":"e9fdc225-aea5-45e8-99d8-7059582f3c70","Type":"ContainerStarted","Data":"897778305b813c98ce5497f03320d32849246b85a18e05a098b8d1300ee996ea"} Jun 05 03:43:28.362052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362027 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"04c2312f5012c7411f678c40550720e1b91bdedee4261f6ca2e50d78922aa8d5"} Jun 05 03:43:28.362205 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362093 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"d9abd0fb9f0de9f359b8d2741d37a1d51691ad4e998e0d46acb7e846ac6a4cb7"} Jun 05 03:43:28.362205 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362159 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"6ea4e61b9b711b884124fc2d6ef0042158b3a897d88551e28a07e7133d78a515"} Jun 05 03:43:28.362205 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362190 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"c21574c766fc3b9cb93989255e009703a05137c33b721565beb9b83fb95c4291"} Jun 05 03:43:28.362373 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362218 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"1c532045f1f7f28bf1234fd4468618d8317b3cb9416534965aae7539bc2c55ca"} Jun 05 03:43:28.362373 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.362245 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"9a6cc3461e026cf9f6666bdf789d46464ba30543f11d7acfde65f8a00c8c9096"} Jun 05 03:43:28.363683 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.363659 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ntqzv" event={"ID":"31489459-370e-4fdb-b6c3-ed1a9bbe3cf4","Type":"ContainerStarted","Data":"001b7733f86d900dc26603c65b1703c6bbf9a67c97f234dd2f6194ef588494ef"} Jun 05 03:43:28.365298 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.365273 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" event={"ID":"99b49b63-2471-41ad-b4e2-40d3ca6a9df2","Type":"ContainerStarted","Data":"5de0176064846d50073e7d7503def4edc04df94d0aa02352a80184482a14d435"} Jun 05 03:43:28.366734 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.366707 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bhml8" event={"ID":"597e9e26-d014-47a4-8c89-d0a9497edecd","Type":"ContainerStarted","Data":"3f025676dbd533f8fb8408a51537b7066d002564475e916d1a7e8853e533b8bf"} Jun 05 03:43:28.368245 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.368225 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5dxn" event={"ID":"eaec1526-4249-4b5b-84f4-7385a75ab5bb","Type":"ContainerStarted","Data":"294d0449909248ec19d5798798d80f424233556e99fa50df0ad16fa6e62f3177"} Jun 05 03:43:28.369833 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.369809 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="bd45986d423d392e5e1cd63299758c69d97d13b7c3d6e3c25afde77a2460235a" exitCode=0 Jun 05 03:43:28.369918 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.369844 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"bd45986d423d392e5e1cd63299758c69d97d13b7c3d6e3c25afde77a2460235a"} Jun 05 03:43:28.371835 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.371800 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mbf7r" podStartSLOduration=4.182752859 podStartE2EDuration="23.371785893s" totalImagesPullingTime="19.189033034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:28.37164861 +0000 UTC m=+23.647021761" watchObservedRunningTime="2026-06-05 03:43:28.371785893 +0000 UTC m=+23.647158964" Jun 05 03:43:28.371979 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.371888 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" podStartSLOduration=22.371879448 podStartE2EDuration="22.371879448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:10.334892552 +0000 UTC m=+5.610265620" watchObservedRunningTime="2026-06-05 03:43:28.371879448 +0000 UTC m=+23.647252503" Jun 05 03:43:28.385676 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.385626 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xn2vb" podStartSLOduration=8.156363759 podStartE2EDuration="23.385609735s" totalImagesPullingTime="15.229245976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:28.385043141 +0000 UTC m=+23.660416212" watchObservedRunningTime="2026-06-05 03:43:28.385609735 +0000 UTC m=+23.660982806" Jun 05 03:43:28.400968 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.400905 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bhml8" podStartSLOduration=4.200311397 podStartE2EDuration="23.400885752s" totalImagesPullingTime="19.200574355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:28.400649305 +0000 UTC m=+23.676022376" watchObservedRunningTime="2026-06-05 03:43:28.400885752 +0000 UTC m=+23.676258824" Jun 05 03:43:28.420063 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.420017 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ntqzv" podStartSLOduration=4.170618666 podStartE2EDuration="23.420001707s" totalImagesPullingTime="19.249383041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:28.419436114 +0000 UTC m=+23.694809184" watchObservedRunningTime="2026-06-05 03:43:28.420001707 +0000 UTC m=+23.695374777" Jun 05 03:43:28.460338 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.460278 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d5dxn" podStartSLOduration=4.278163232 podStartE2EDuration="23.460257585s" totalImagesPullingTime="19.182094353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:28.438886699 +0000 UTC m=+23.714259769" watchObservedRunningTime="2026-06-05 03:43:28.460257585 +0000 UTC m=+23.735630654" Jun 05 03:43:28.849287 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:28.849258 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 03:43:29.202729 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.202641 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:29.202729 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.202685 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:29.203137 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.202642 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:29.203137 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:29.202787 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:29.203137 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:29.202856 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:29.203137 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:29.202929 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:29.219907 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.219802 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T03:43:28.849278995Z","UUID":"1414b8a7-e6dd-4d8b-bef0-113665081810","Handler":null,"Name":"","Endpoint":""} Jun 05 03:43:29.221819 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.221790 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 03:43:29.221941 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.221828 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 03:43:29.374848 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.374769 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwnj5" event={"ID":"443e7341-adde-4111-900c-6802190e5123","Type":"ContainerStarted","Data":"ca3e636f12a7421d152c20039de6cbc93da40a12ff008668d25b5cedf983700f"} Jun 05 03:43:29.377054 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.377021 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" event={"ID":"99b49b63-2471-41ad-b4e2-40d3ca6a9df2","Type":"ContainerStarted","Data":"e7876808e7e65a390f1305bb7540f775409d9b6855bbd2a15ee6c1287f8303d2"} Jun 05 03:43:29.379953 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.379925 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:29.380469 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.380450 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:29.400687 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:29.400634 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwnj5" podStartSLOduration=5.214480677 podStartE2EDuration="24.400618315s" totalImagesPullingTime="19.186137638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:29.400195482 +0000 UTC m=+24.675568551" watchObservedRunningTime="2026-06-05 03:43:29.400618315 +0000 UTC m=+24.675991422" Jun 05 03:43:30.383945 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:30.383679 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"1c5d58fb62a0522fbb1e7904e221c502536d873df9cd579f3ad06ec1cf9ed41d"} Jun 05 03:43:30.386066 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:30.386033 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" event={"ID":"99b49b63-2471-41ad-b4e2-40d3ca6a9df2","Type":"ContainerStarted","Data":"0d1462ff3d3a64180a26834788ee0a3fad9502a4c85ae9ffce3bf2d4638161c7"} Jun 05 03:43:30.403692 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:30.403601 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzn7" podStartSLOduration=4.058486275 podStartE2EDuration="25.403562301s" totalImagesPullingTime="21.345076026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:30.402400702 +0000 UTC m=+25.677773772" watchObservedRunningTime="2026-06-05 03:43:30.403562301 +0000 UTC m=+25.678935374" Jun 05 03:43:31.202007 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:31.201978 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:31.202310 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:31.201974 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:31.202310 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:31.202090 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:31.202310 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:31.201988 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:31.202310 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:31.202218 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:31.202537 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:31.202341 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:31.387742 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:31.387715 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 03:43:33.202542 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.202361 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:33.203232 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.202361 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:33.203232 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:33.202643 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:33.203232 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.202361 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:33.203232 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:33.202680 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:33.203232 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:33.202768 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:33.394029 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.393997 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerStarted","Data":"783a6c5d77b125039063b3e7ef3249a7dacb6ea23ad917c8184c5a8b45ec6d40"} Jun 05 03:43:33.397637 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.397566 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" event={"ID":"9d8b275f-057f-49a2-83ce-50d011abef47","Type":"ContainerStarted","Data":"7c6be4e4d715348a934d1afa000f2a468d247356e647f22e8d390ad7fb613aa5"} Jun 05 03:43:33.397792 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.397778 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:33.397848 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.397836 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:33.413201 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.413170 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:33.439677 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:33.439614 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" podStartSLOduration=9.176298763 podStartE2EDuration="28.439595307s" totalImagesPullingTime="19.263296544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:33.438716279 +0000 UTC m=+28.714089348" watchObservedRunningTime="2026-06-05 03:43:33.439595307 +0000 UTC m=+28.714968379" Jun 05 03:43:34.401764 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:34.401733 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="783a6c5d77b125039063b3e7ef3249a7dacb6ea23ad917c8184c5a8b45ec6d40" exitCode=0 Jun 05 03:43:34.402264 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:34.401827 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"783a6c5d77b125039063b3e7ef3249a7dacb6ea23ad917c8184c5a8b45ec6d40"} Jun 05 03:43:34.402264 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:34.402230 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:34.417754 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:34.417730 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:43:35.203075 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.203034 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:35.203297 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.203182 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:35.203297 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.203199 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:35.203297 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.203278 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:35.203433 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.203287 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:35.203433 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.203364 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:35.257228 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.257200 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5b7vt"] Jun 05 03:43:35.260436 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.260409 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98g5d"] Jun 05 03:43:35.261532 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.261509 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4v49z"] Jun 05 03:43:35.404377 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.404346 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:35.404857 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.404455 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:35.404857 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.404781 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:35.404857 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.404851 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:35.405029 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.404880 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:35.405029 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:35.404962 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:35.751667 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.751481 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:35.751849 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.751810 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 03:43:35.752070 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:35.752052 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xn2vb" Jun 05 03:43:36.409822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:36.409781 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="8bfa124b61ab156207965083e96b32565b1e36d4199857649346f0d588f82bb2" exitCode=0 Jun 05 03:43:36.410247 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:36.409843 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"8bfa124b61ab156207965083e96b32565b1e36d4199857649346f0d588f82bb2"} Jun 05 03:43:37.202189 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:37.202158 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:37.202189 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:37.202190 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:37.202408 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:37.202274 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:37.202408 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:37.202321 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:37.202408 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:37.202339 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:37.202518 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:37.202452 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:38.416751 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:38.416667 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="05b5e8064ad2c4a26197cf51c14b55d59f3774f735ec6649af614076e62c0524" exitCode=0 Jun 05 03:43:38.416751 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:38.416720 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"05b5e8064ad2c4a26197cf51c14b55d59f3774f735ec6649af614076e62c0524"} Jun 05 03:43:38.998273 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:38.998233 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:38.998273 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:38.998281 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:38.998670 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:38.998415 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:38.998670 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:38.998493 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret podName:ea9abade-2a74-44f3-8341-ab4b830c5ce4 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:10.998471862 +0000 UTC m=+66.273844917 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret") pod "global-pull-secret-syncer-98g5d" (UID: "ea9abade-2a74-44f3-8341-ab4b830c5ce4") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:38.998670 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:38.998419 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:38.998670 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:38.998581 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:10.99856226 +0000 UTC m=+66.273935331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:39.099065 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:39.099028 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:39.099286 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.099211 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:39.099286 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.099237 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:39.099286 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.099251 2551 projected.go:196] Error preparing data for projected volume kube-api-access-dkhf6 for pod openshift-network-diagnostics/network-check-target-5b7vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:39.099434 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.099308 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6 podName:871664aa-ba34-4679-b6db-18b5128a73cb nodeName:}" failed. No retries permitted until 2026-06-05 03:44:11.099291415 +0000 UTC m=+66.374664476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkhf6" (UniqueName: "kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6") pod "network-check-target-5b7vt" (UID: "871664aa-ba34-4679-b6db-18b5128a73cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:39.201900 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:39.201872 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:39.201900 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:39.201886 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:39.201900 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:39.201886 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:39.202132 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.201976 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:43:39.202132 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.202060 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98g5d" podUID="ea9abade-2a74-44f3-8341-ab4b830c5ce4" Jun 05 03:43:39.202132 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:39.202098 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b7vt" podUID="871664aa-ba34-4679-b6db-18b5128a73cb" Jun 05 03:43:40.004753 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.004725 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeReady" Jun 05 03:43:40.005310 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.004870 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 03:43:40.040089 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.040054 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh"] Jun 05 03:43:40.043642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.043484 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb"] Jun 05 03:43:40.043642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.043489 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.046499 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.046475 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 03:43:40.046816 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.046763 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 03:43:40.046923 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.046818 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 03:43:40.046923 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.046823 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jrmfs\"" Jun 05 03:43:40.047098 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.047080 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 03:43:40.047563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.047547 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:43:40.047695 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.047674 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.050386 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.050348 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 03:43:40.051768 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.051625 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v"] Jun 05 03:43:40.053631 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.053610 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.056723 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.056703 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.057865 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.057848 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 03:43:40.058214 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.058189 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 03:43:40.058311 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.058201 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6ccnq\"" Jun 05 03:43:40.058632 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.058615 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh"] Jun 05 03:43:40.059337 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.059318 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2g5xb"] Jun 05 03:43:40.059828 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.059808 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 05 03:43:40.059979 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.059961 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 03:43:40.060073 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.060055 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 05 03:43:40.060590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.060568 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 05 03:43:40.060680 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.060605 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 05 03:43:40.063181 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.063155 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.063989 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.063969 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 03:43:40.066554 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.066535 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v"] Jun 05 03:43:40.067101 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.067067 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 03:43:40.067233 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.067157 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 03:43:40.067371 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.067352 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 03:43:40.067688 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.067661 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-phxs2\"" Jun 05 03:43:40.068269 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.068247 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb"] Jun 05 03:43:40.068996 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.068957 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:43:40.074452 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.074432 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vnn8d"] Jun 05 03:43:40.079560 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.079536 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2g5xb"] Jun 05 03:43:40.079699 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.079682 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.082290 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.082270 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4t6d\"" Jun 05 03:43:40.082631 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.082610 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 03:43:40.082722 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.082610 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 03:43:40.088056 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.088035 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnn8d"] Jun 05 03:43:40.206566 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206487 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.206566 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206524 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-tmp-dir\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.206566 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206647 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206677 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206705 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206731 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg9sk\" (UniqueName: \"kubernetes.io/projected/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-kube-api-access-rg9sk\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206754 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-config-volume\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.206844 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206785 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs86j\" (UniqueName: \"kubernetes.io/projected/65d54707-a790-4b52-97e7-06400edbb720-kube-api-access-rs86j\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206888 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8029c01e-0113-4f03-b812-661cb58cca37-cert\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206924 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnzj\" (UniqueName: \"kubernetes.io/projected/8029c01e-0113-4f03-b812-661cb58cca37-kube-api-access-stnzj\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.206989 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207022 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207050 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207077 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.207133 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207124 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.207422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207182 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84b9257-73cf-4057-bdf5-505b69980173-tmp\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.207422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207258 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4mb7\" (UniqueName: \"kubernetes.io/projected/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-kube-api-access-c4mb7\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.207422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207319 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8mr\" (UniqueName: \"kubernetes.io/projected/d84b9257-73cf-4057-bdf5-505b69980173-kube-api-access-6f8mr\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.207422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207344 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.207422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207389 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65d54707-a790-4b52-97e7-06400edbb720-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.207666 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207413 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.207666 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207475 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7w4\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.207666 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207527 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d84b9257-73cf-4057-bdf5-505b69980173-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.207666 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.207551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.228041 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.228005 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xn2vb_e9fdc225-aea5-45e8-99d8-7059582f3c70/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:40.308473 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308437 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs86j\" (UniqueName: \"kubernetes.io/projected/65d54707-a790-4b52-97e7-06400edbb720-kube-api-access-rs86j\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308477 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8029c01e-0113-4f03-b812-661cb58cca37-cert\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308505 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stnzj\" (UniqueName: \"kubernetes.io/projected/8029c01e-0113-4f03-b812-661cb58cca37-kube-api-access-stnzj\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308532 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308556 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308601 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308632 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.308657 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308654 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84b9257-73cf-4057-bdf5-505b69980173-tmp\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4mb7\" (UniqueName: \"kubernetes.io/projected/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-kube-api-access-c4mb7\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.308697 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308736 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8mr\" (UniqueName: \"kubernetes.io/projected/d84b9257-73cf-4057-bdf5-505b69980173-kube-api-access-6f8mr\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308759 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308804 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65d54707-a790-4b52-97e7-06400edbb720-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308825 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.308854 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:40.808837013 +0000 UTC m=+36.084210080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308874 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7w4\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308912 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d84b9257-73cf-4057-bdf5-505b69980173-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308936 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308963 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.308989 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-tmp-dir\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309015 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309051 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309076 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.309170 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309100 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309153 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg9sk\" (UniqueName: \"kubernetes.io/projected/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-kube-api-access-rg9sk\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.309164 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309179 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-config-volume\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.309182 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.309266 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:40.809252338 +0000 UTC m=+36.084625408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309379 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309479 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-tmp-dir\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.309917 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.309885 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.310312 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.310001 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.310413 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.310390 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.310584 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.310563 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-config-volume\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.311401 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.310887 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84b9257-73cf-4057-bdf5-505b69980173-tmp\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.314183 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314020 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.314183 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314049 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8029c01e-0113-4f03-b812-661cb58cca37-cert\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.314183 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-ca\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.314183 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314094 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.314434 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314375 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.314434 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314418 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d84b9257-73cf-4057-bdf5-505b69980173-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.314651 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314625 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-hub\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.314770 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.314751 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.320795 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.316851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65d54707-a790-4b52-97e7-06400edbb720-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.320795 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.318300 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.321817 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.321796 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs86j\" (UniqueName: \"kubernetes.io/projected/65d54707-a790-4b52-97e7-06400edbb720-kube-api-access-rs86j\") pod \"managed-serviceaccount-addon-agent-c8c5d569d-vgpvh\" (UID: \"65d54707-a790-4b52-97e7-06400edbb720\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.321961 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.321910 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnzj\" (UniqueName: \"kubernetes.io/projected/8029c01e-0113-4f03-b812-661cb58cca37-kube-api-access-stnzj\") pod \"ingress-canary-2g5xb\" (UID: \"8029c01e-0113-4f03-b812-661cb58cca37\") " pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.322070 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.321933 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xn2vb_e9fdc225-aea5-45e8-99d8-7059582f3c70/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:40.323591 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.323553 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8mr\" (UniqueName: \"kubernetes.io/projected/d84b9257-73cf-4057-bdf5-505b69980173-kube-api-access-6f8mr\") pod \"klusterlet-addon-workmgr-5b88b94cd7-cwkgb\" (UID: \"d84b9257-73cf-4057-bdf5-505b69980173\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.324056 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.324013 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4mb7\" (UniqueName: \"kubernetes.io/projected/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-kube-api-access-c4mb7\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.324646 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.324617 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg9sk\" (UniqueName: \"kubernetes.io/projected/88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0-kube-api-access-rg9sk\") pod \"cluster-proxy-proxy-agent-6b79469bc5-dmd5v\" (UID: \"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.324780 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.324669 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7w4\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.364462 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.364432 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:43:40.374161 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.374133 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:40.391228 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.391193 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:43:40.407794 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.407692 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2g5xb" Jun 05 03:43:40.564473 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.564418 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh"] Jun 05 03:43:40.571523 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:40.571493 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65d54707_a790_4b52_97e7_06400edbb720.slice/crio-f5849a2a07e27a03b7c64fca66d4f505f1a1e0539a811adb1033c15cc843d31c WatchSource:0}: Error finding container f5849a2a07e27a03b7c64fca66d4f505f1a1e0539a811adb1033c15cc843d31c: Status 404 returned error can't find the container with id f5849a2a07e27a03b7c64fca66d4f505f1a1e0539a811adb1033c15cc843d31c Jun 05 03:43:40.579684 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.579653 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb"] Jun 05 03:43:40.584597 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:40.584442 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84b9257_73cf_4057_bdf5_505b69980173.slice/crio-1f8ac7917f66f4807e413bbce596735c7c49a5ca155850c79eb1936010661116 WatchSource:0}: Error finding container 1f8ac7917f66f4807e413bbce596735c7c49a5ca155850c79eb1936010661116: Status 404 returned error can't find the container with id 1f8ac7917f66f4807e413bbce596735c7c49a5ca155850c79eb1936010661116 Jun 05 03:43:40.603443 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.603413 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v"] Jun 05 03:43:40.605991 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.605965 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2g5xb"] Jun 05 03:43:40.607276 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:40.607168 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88b4f0e8_3da1_4dc7_9523_cc60a1c8e5a0.slice/crio-e1e0451d2e8b2b6d6d3409fb6f902ab4423099e8c18e9ca2eb27b3ab181df227 WatchSource:0}: Error finding container e1e0451d2e8b2b6d6d3409fb6f902ab4423099e8c18e9ca2eb27b3ab181df227: Status 404 returned error can't find the container with id e1e0451d2e8b2b6d6d3409fb6f902ab4423099e8c18e9ca2eb27b3ab181df227 Jun 05 03:43:40.609741 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:43:40.609707 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8029c01e_0113_4f03_b812_661cb58cca37.slice/crio-d4f9d826fece96a08a987f9ae1972cb00006f0589787e9ec3313e015300967e8 WatchSource:0}: Error finding container d4f9d826fece96a08a987f9ae1972cb00006f0589787e9ec3313e015300967e8: Status 404 returned error can't find the container with id d4f9d826fece96a08a987f9ae1972cb00006f0589787e9ec3313e015300967e8 Jun 05 03:43:40.814505 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.814471 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:40.814505 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:40.814510 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:40.814742 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.814641 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:40.814742 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.814661 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:40.814742 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.814673 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:40.814742 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.814719 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:41.81470683 +0000 UTC m=+37.090079878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:43:40.814742 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:40.814733 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:41.814727381 +0000 UTC m=+37.090100429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:41.202302 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.202226 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:43:41.202302 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.202251 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:43:41.202817 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.202226 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:43:41.206249 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206226 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:43:41.206389 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206275 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7rr7\"" Jun 05 03:43:41.206389 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206228 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:43:41.206389 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206228 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:43:41.206389 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206229 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:43:41.206590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.206277 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-45r96\"" Jun 05 03:43:41.428376 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.428338 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2g5xb" event={"ID":"8029c01e-0113-4f03-b812-661cb58cca37","Type":"ContainerStarted","Data":"d4f9d826fece96a08a987f9ae1972cb00006f0589787e9ec3313e015300967e8"} Jun 05 03:43:41.430978 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.430913 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerStarted","Data":"f5849a2a07e27a03b7c64fca66d4f505f1a1e0539a811adb1033c15cc843d31c"} Jun 05 03:43:41.433225 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.433155 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerStarted","Data":"e1e0451d2e8b2b6d6d3409fb6f902ab4423099e8c18e9ca2eb27b3ab181df227"} Jun 05 03:43:41.435094 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.435043 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerStarted","Data":"1f8ac7917f66f4807e413bbce596735c7c49a5ca155850c79eb1936010661116"} Jun 05 03:43:41.822173 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.822134 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:41.822358 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:41.822190 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:41.822428 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:41.822412 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:41.822487 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:41.822429 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:41.822487 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:41.822486 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:43.822467575 +0000 UTC m=+39.097840644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:43:41.822897 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:41.822876 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:41.822981 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:41.822932 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:43.822915967 +0000 UTC m=+39.098289029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:43.840564 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:43.840525 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:43.840564 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:43.840575 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:43.841088 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:43.840701 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:43.841088 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:43.840751 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:43.841088 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:43.840770 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:43.841088 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:43.840778 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:47.840757219 +0000 UTC m=+43.116130290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:43.841088 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:43.840824 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:47.840806022 +0000 UTC m=+43.116179094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:43:47.878965 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:47.878753 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:47.878965 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:47.878966 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:47.879504 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:47.878937 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:47.879504 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:47.879083 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:55.879061863 +0000 UTC m=+51.154434912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:47.879504 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:47.879138 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:47.879504 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:47.879152 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:47.879504 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:47.879199 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:55.879183554 +0000 UTC m=+51.154556621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:43:50.460818 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.460776 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2g5xb" event={"ID":"8029c01e-0113-4f03-b812-661cb58cca37","Type":"ContainerStarted","Data":"e0cb38884fffba3cfda8678809c0c87569775494de90a250bc528079165f9e13"} Jun 05 03:43:50.462334 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.462304 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerStarted","Data":"c45dbb5651f5a7f7ef2b41e305710392fce8b5ca5eb48a9f064fca2b35fcabd5"} Jun 05 03:43:50.464996 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.464970 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="777df57a6ced7dd20db3157390b175c5780e46d3449c5e10a2f346332f31c96d" exitCode=0 Jun 05 03:43:50.465122 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.465052 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"777df57a6ced7dd20db3157390b175c5780e46d3449c5e10a2f346332f31c96d"} Jun 05 03:43:50.467124 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.467088 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerStarted","Data":"4f2b847377b85031a752f2c295fe345c3f34b8fd7e2eee436858f5e239072200"} Jun 05 03:43:50.467217 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.467141 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerStarted","Data":"c8874d3392f159ee2b31346a04d05aaa8df081b6fbf1de1fa2cb61ab42c6fc2d"} Jun 05 03:43:50.467217 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.467156 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerStarted","Data":"6141e9415c180854f992f16555f0ab16c565ea9a5526c5215d205e877043d06d"} Jun 05 03:43:50.468544 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.468425 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerStarted","Data":"8e4ceb694b6f3379b3250635410eadca87279169a5c5cd3d797bbaf46fd5bec9"} Jun 05 03:43:50.468632 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.468617 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:50.470453 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.470410 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:43:50.478551 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.478512 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2g5xb" podStartSLOduration=1.106574162 podStartE2EDuration="10.478499415s" totalImagesPullingTime="9.371925253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:50.477158182 +0000 UTC m=+45.752531252" watchObservedRunningTime="2026-06-05 03:43:50.478499415 +0000 UTC m=+45.753872519" Jun 05 03:43:50.512065 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.511960 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" podStartSLOduration=28.076299831 podStartE2EDuration="37.511940326s" totalImagesPullingTime="9.435640495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:50.511849372 +0000 UTC m=+45.787222446" watchObservedRunningTime="2026-06-05 03:43:50.511940326 +0000 UTC m=+45.787313391" Jun 05 03:43:50.529535 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.529476 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podStartSLOduration=28.135908813 podStartE2EDuration="37.529454589s" totalImagesPullingTime="9.393545776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:50.528428813 +0000 UTC m=+45.803801894" watchObservedRunningTime="2026-06-05 03:43:50.529454589 +0000 UTC m=+45.804827660" Jun 05 03:43:50.546260 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:50.546215 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" podStartSLOduration=28.133187074 podStartE2EDuration="37.546199752s" totalImagesPullingTime="9.413012678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:50.54577566 +0000 UTC m=+45.821148730" watchObservedRunningTime="2026-06-05 03:43:50.546199752 +0000 UTC m=+45.821572822" Jun 05 03:43:51.473922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:51.473832 2551 generic.go:356] "Generic (PLEG): container finished" podID="da7b3e0b-25a4-465c-bb29-e75e66c61417" containerID="91731eb307f72759f47779d04eb9ea7411c05eb320becfe139dc09eba85f81fa" exitCode=0 Jun 05 03:43:51.474396 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:51.473928 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerDied","Data":"91731eb307f72759f47779d04eb9ea7411c05eb320becfe139dc09eba85f81fa"} Jun 05 03:43:52.481396 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:52.481363 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" event={"ID":"da7b3e0b-25a4-465c-bb29-e75e66c61417","Type":"ContainerStarted","Data":"66df8b3246a4c16f2a03f0bfa05cd5fec7132982a7c777ccb547befd343b9efb"} Jun 05 03:43:52.503121 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:52.503052 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xpkjn" podStartSLOduration=9.720707169 podStartE2EDuration="47.503037975s" totalImagesPullingTime="37.782330806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:52.501599765 +0000 UTC m=+47.776972836" watchObservedRunningTime="2026-06-05 03:43:52.503037975 +0000 UTC m=+47.778411045" Jun 05 03:43:55.937625 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:55.937582 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:43:55.937625 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:43:55.937627 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:43:55.938102 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:55.937733 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:55.938102 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:55.937772 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:43:55.938102 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:55.937787 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:43:55.938102 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:55.937799 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:11.937783028 +0000 UTC m=+67.213156075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:43:55.938102 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:43:55.937845 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:11.937830007 +0000 UTC m=+67.213203058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:44:06.420976 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:06.420942 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdw8q" Jun 05 03:44:11.048293 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.048232 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:44:11.048293 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.048287 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:44:11.051171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.051152 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:44:11.051238 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.051169 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:44:11.059252 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.059234 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:44:11.059301 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.059294 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:45:15.059277276 +0000 UTC m=+130.334650327 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : secret "metrics-daemon-secret" not found Jun 05 03:44:11.062795 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.062774 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea9abade-2a74-44f3-8341-ab4b830c5ce4-original-pull-secret\") pod \"global-pull-secret-syncer-98g5d\" (UID: \"ea9abade-2a74-44f3-8341-ab4b830c5ce4\") " pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:44:11.149595 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.149559 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:44:11.152329 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.152307 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:44:11.162956 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.162929 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:44:11.173672 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.173635 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhf6\" (UniqueName: \"kubernetes.io/projected/871664aa-ba34-4679-b6db-18b5128a73cb-kube-api-access-dkhf6\") pod \"network-check-target-5b7vt\" (UID: \"871664aa-ba34-4679-b6db-18b5128a73cb\") " pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:44:11.214884 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.214848 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98g5d" Jun 05 03:44:11.233852 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.233827 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-45r96\"" Jun 05 03:44:11.242055 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.242029 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:44:11.347979 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.347949 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98g5d"] Jun 05 03:44:11.351628 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:44:11.351592 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9abade_2a74_44f3_8341_ab4b830c5ce4.slice/crio-4d7aaf7bf36a6e128419bd4b818e9d713c9b5993b034554deeb7793b3408fe6f WatchSource:0}: Error finding container 4d7aaf7bf36a6e128419bd4b818e9d713c9b5993b034554deeb7793b3408fe6f: Status 404 returned error can't find the container with id 4d7aaf7bf36a6e128419bd4b818e9d713c9b5993b034554deeb7793b3408fe6f Jun 05 03:44:11.375642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.375615 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5b7vt"] Jun 05 03:44:11.378407 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:44:11.378382 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871664aa_ba34_4679_b6db_18b5128a73cb.slice/crio-4b626e9307477315e0e635341816e45042cd172a446828a040827c20874d9855 WatchSource:0}: Error finding container 4b626e9307477315e0e635341816e45042cd172a446828a040827c20874d9855: Status 404 returned error can't find the container with id 4b626e9307477315e0e635341816e45042cd172a446828a040827c20874d9855 Jun 05 03:44:11.540485 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.540444 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98g5d" event={"ID":"ea9abade-2a74-44f3-8341-ab4b830c5ce4","Type":"ContainerStarted","Data":"4d7aaf7bf36a6e128419bd4b818e9d713c9b5993b034554deeb7793b3408fe6f"} Jun 05 03:44:11.541409 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.541386 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5b7vt" event={"ID":"871664aa-ba34-4679-b6db-18b5128a73cb","Type":"ContainerStarted","Data":"4b626e9307477315e0e635341816e45042cd172a446828a040827c20874d9855"} Jun 05 03:44:11.956184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.956149 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:44:11.956184 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:11.956183 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:44:11.956386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.956285 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:44:11.956386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.956297 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:44:11.956386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.956300 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:11.956386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.956346 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:43.956332 +0000 UTC m=+99.231705048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:44:11.956386 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:11.956357 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:43.956351945 +0000 UTC m=+99.231724994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:44:15.555734 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:15.555697 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5b7vt" event={"ID":"871664aa-ba34-4679-b6db-18b5128a73cb","Type":"ContainerStarted","Data":"f6aa1f37018939e1aa1595cf91c11198f1e8097570cac66559a4e2bda3177c15"} Jun 05 03:44:15.556195 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:15.555825 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:44:15.571367 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:15.571317 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5b7vt" podStartSLOduration=67.325093338 podStartE2EDuration="1m10.571301501s" totalImagesPullingTime="3.246208163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:44:15.570137627 +0000 UTC m=+70.845510697" watchObservedRunningTime="2026-06-05 03:44:15.571301501 +0000 UTC m=+70.846674570" Jun 05 03:44:16.560227 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:16.560175 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98g5d" event={"ID":"ea9abade-2a74-44f3-8341-ab4b830c5ce4","Type":"ContainerStarted","Data":"b594af3e3cf3df9c4592d5114d65cf03a1e8fbfe5b2629e08d9c740f1135e8e3"} Jun 05 03:44:16.575928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:16.575875 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-98g5d" podStartSLOduration=66.857867965 podStartE2EDuration="1m11.57585953s" totalImagesPullingTime="4.717991565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:44:16.574889544 +0000 UTC m=+71.850262615" watchObservedRunningTime="2026-06-05 03:44:16.57585953 +0000 UTC m=+71.851232596" Jun 05 03:44:44.001254 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:44.001085 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:44:44.001254 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:44.001179 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:44:44.001254 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:44.001240 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:44.001829 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:44.001285 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:44:44.001829 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:44.001298 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:44:44.001829 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:44.001318 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:45:48.001300714 +0000 UTC m=+163.276673762 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:44:44.001829 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:44:44.001347 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:45:48.00133477 +0000 UTC m=+163.276707819 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:44:46.563142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:44:46.563098 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5b7vt" Jun 05 03:45:15.129284 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:15.129230 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:45:15.129772 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:15.129377 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:45:15.129772 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:15.129441 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:17.129425577 +0000 UTC m=+252.404798624 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : secret "metrics-daemon-secret" not found Jun 05 03:45:43.083953 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:43.083907 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" Jun 05 03:45:43.112684 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:43.112648 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vnn8d" podUID="3f368981-12cc-4126-8dd2-5d91a6ecb2e4" Jun 05 03:45:43.811041 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:43.811013 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:45:43.811220 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:43.811014 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:45:44.224349 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:44.224255 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:45:48.063101 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:48.063062 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:45:48.063101 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:48.063121 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:45:48.063608 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:48.063236 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:45:48.063608 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:48.063249 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cddd97cf-jjv2r: secret "image-registry-tls" not found Jun 05 03:45:48.063608 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:48.063302 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls podName:b97f5826-da9c-4409-9c47-45d42f099b51 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:50.063288693 +0000 UTC m=+285.338661742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls") pod "image-registry-8cddd97cf-jjv2r" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51") : secret "image-registry-tls" not found Jun 05 03:45:48.063608 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:48.063235 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:45:48.063608 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:45:48.063395 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls podName:3f368981-12cc-4126-8dd2-5d91a6ecb2e4 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:50.063374525 +0000 UTC m=+285.338747572 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls") pod "dns-default-vnn8d" (UID: "3f368981-12cc-4126-8dd2-5d91a6ecb2e4") : secret "dns-default-metrics-tls" not found Jun 05 03:45:50.365617 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.365564 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" podUID="65d54707-a790-4b52-97e7-06400edbb720" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/healthz\": dial tcp 10.132.0.6:8000: connect: connection refused" Jun 05 03:45:50.375428 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.375393 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podUID="d84b9257-73cf-4057-bdf5-505b69980173" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/healthz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jun 05 03:45:50.469891 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.469839 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podUID="d84b9257-73cf-4057-bdf5-505b69980173" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jun 05 03:45:50.831929 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.831890 2551 generic.go:356] "Generic (PLEG): container finished" podID="d84b9257-73cf-4057-bdf5-505b69980173" containerID="8e4ceb694b6f3379b3250635410eadca87279169a5c5cd3d797bbaf46fd5bec9" exitCode=1 Jun 05 03:45:50.832129 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.831966 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerDied","Data":"8e4ceb694b6f3379b3250635410eadca87279169a5c5cd3d797bbaf46fd5bec9"} Jun 05 03:45:50.832371 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.832347 2551 scope.go:117] "RemoveContainer" containerID="8e4ceb694b6f3379b3250635410eadca87279169a5c5cd3d797bbaf46fd5bec9" Jun 05 03:45:50.833501 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.833476 2551 generic.go:356] "Generic (PLEG): container finished" podID="65d54707-a790-4b52-97e7-06400edbb720" containerID="c45dbb5651f5a7f7ef2b41e305710392fce8b5ca5eb48a9f064fca2b35fcabd5" exitCode=255 Jun 05 03:45:50.833640 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.833545 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerDied","Data":"c45dbb5651f5a7f7ef2b41e305710392fce8b5ca5eb48a9f064fca2b35fcabd5"} Jun 05 03:45:50.833803 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:50.833790 2551 scope.go:117] "RemoveContainer" containerID="c45dbb5651f5a7f7ef2b41e305710392fce8b5ca5eb48a9f064fca2b35fcabd5" Jun 05 03:45:51.837805 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:51.837762 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerStarted","Data":"6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa"} Jun 05 03:45:51.838242 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:51.838130 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:45:51.839219 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:51.839190 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:45:51.839820 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:51.839796 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerStarted","Data":"290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d"} Jun 05 03:45:59.202724 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:45:59.202633 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:47:17.216856 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:17.216817 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:47:17.217433 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:17.216984 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:47:17.217433 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:17.217047 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs podName:0d566b68-2109-4850-a2ab-ce18c50a0ce5 nodeName:}" failed. No retries permitted until 2026-06-05 03:49:19.21702983 +0000 UTC m=+374.492402893 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs") pod "network-metrics-daemon-4v49z" (UID: "0d566b68-2109-4850-a2ab-ce18c50a0ce5") : secret "metrics-daemon-secret" not found Jun 05 03:47:24.284040 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:24.284011 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5dxn_eaec1526-4249-4b5b-84f4-7385a75ab5bb/dns-node-resolver/0.log" Jun 05 03:47:25.684606 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:25.684579 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mbf7r_43e28fdd-56ca-4754-bb13-cad9b1205068/node-ca/0.log" Jun 05 03:47:26.090564 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:26.090536 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2g5xb_8029c01e-0113-4f03-b812-661cb58cca37/serve-healthcheck-canary/0.log" Jun 05 03:47:42.792036 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.792004 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4cljv"] Jun 05 03:47:42.795060 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.795033 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:42.797745 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.797723 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 03:47:42.797856 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.797805 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 03:47:42.798272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.798253 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 03:47:42.798884 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.798869 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nqgr\"" Jun 05 03:47:42.798991 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.798908 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 03:47:42.810185 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.810152 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cljv"] Jun 05 03:47:42.910827 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.910786 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebef173e-14e0-4ae1-bede-1105188dd491-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:42.910997 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.910842 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwk7l\" (UniqueName: \"kubernetes.io/projected/ebef173e-14e0-4ae1-bede-1105188dd491-kube-api-access-cwk7l\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:42.910997 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.910870 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebef173e-14e0-4ae1-bede-1105188dd491-data-volume\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:42.910997 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.910952 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebef173e-14e0-4ae1-bede-1105188dd491-crio-socket\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:42.910997 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:42.910990 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebef173e-14e0-4ae1-bede-1105188dd491-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012338 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012298 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebef173e-14e0-4ae1-bede-1105188dd491-crio-socket\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012338 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012338 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebef173e-14e0-4ae1-bede-1105188dd491-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012377 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebef173e-14e0-4ae1-bede-1105188dd491-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012402 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwk7l\" (UniqueName: \"kubernetes.io/projected/ebef173e-14e0-4ae1-bede-1105188dd491-kube-api-access-cwk7l\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012426 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebef173e-14e0-4ae1-bede-1105188dd491-data-volume\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012428 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebef173e-14e0-4ae1-bede-1105188dd491-crio-socket\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012896 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012876 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebef173e-14e0-4ae1-bede-1105188dd491-data-volume\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.012972 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.012948 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebef173e-14e0-4ae1-bede-1105188dd491-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.014780 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.014757 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebef173e-14e0-4ae1-bede-1105188dd491-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.022884 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.022854 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwk7l\" (UniqueName: \"kubernetes.io/projected/ebef173e-14e0-4ae1-bede-1105188dd491-kube-api-access-cwk7l\") pod \"insights-runtime-extractor-4cljv\" (UID: \"ebef173e-14e0-4ae1-bede-1105188dd491\") " pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.104253 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.104157 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cljv" Jun 05 03:47:43.230484 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:43.230454 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cljv"] Jun 05 03:47:43.233504 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:47:43.233467 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebef173e_14e0_4ae1_bede_1105188dd491.slice/crio-283ca730860b2a4991807324006edd37582ea9e9b752cb8942051bd51a4b299e WatchSource:0}: Error finding container 283ca730860b2a4991807324006edd37582ea9e9b752cb8942051bd51a4b299e: Status 404 returned error can't find the container with id 283ca730860b2a4991807324006edd37582ea9e9b752cb8942051bd51a4b299e Jun 05 03:47:44.174679 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:44.174647 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cljv" event={"ID":"ebef173e-14e0-4ae1-bede-1105188dd491","Type":"ContainerStarted","Data":"4b5d67f3cf8bba91ce5c83b9c0e7c1ce6473812c8f9c8ad7bfb8bb68bcdf830b"} Jun 05 03:47:44.174959 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:44.174715 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cljv" event={"ID":"ebef173e-14e0-4ae1-bede-1105188dd491","Type":"ContainerStarted","Data":"283ca730860b2a4991807324006edd37582ea9e9b752cb8942051bd51a4b299e"} Jun 05 03:47:45.179800 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:45.179762 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cljv" event={"ID":"ebef173e-14e0-4ae1-bede-1105188dd491","Type":"ContainerStarted","Data":"a1ff9cac7e19673727feced3bbe55206cbfd4524284204b3e63c3c13abdd8ac1"} Jun 05 03:47:46.184522 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:46.184487 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cljv" event={"ID":"ebef173e-14e0-4ae1-bede-1105188dd491","Type":"ContainerStarted","Data":"be065c12eb54355c238bf74b3e8c46cb2f0733412edfbafc6ca940879e6a48cc"} Jun 05 03:47:46.202610 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:46.202557 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4cljv" podStartSLOduration=1.831213001 podStartE2EDuration="4.202541245s" totalImagesPullingTime="2.371328244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:47:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:46.201234622 +0000 UTC m=+281.476607694" watchObservedRunningTime="2026-06-05 03:47:46.202541245 +0000 UTC m=+281.477914314" Jun 05 03:47:46.811997 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:46.811949 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" Jun 05 03:47:46.811997 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:46.811983 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vnn8d" podUID="3f368981-12cc-4126-8dd2-5d91a6ecb2e4" Jun 05 03:47:47.187595 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:47.187516 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:47:47.187595 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:47.187528 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:47:50.065069 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.065018 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:47:50.065069 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.065072 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:47:50.067422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.067397 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f368981-12cc-4126-8dd2-5d91a6ecb2e4-metrics-tls\") pod \"dns-default-vnn8d\" (UID: \"3f368981-12cc-4126-8dd2-5d91a6ecb2e4\") " pod="openshift-dns/dns-default-vnn8d" Jun 05 03:47:50.067645 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.067622 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"image-registry-8cddd97cf-jjv2r\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:47:50.191272 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.191239 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6ccnq\"" Jun 05 03:47:50.192452 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.192434 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4t6d\"" Jun 05 03:47:50.199571 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.199547 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:47:50.199689 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.199634 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:47:50.207516 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.207494 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rvhsb"] Jun 05 03:47:50.210875 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.210852 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.213756 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.213572 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 03:47:50.213756 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.213600 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 03:47:50.213756 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.213572 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 03:47:50.213756 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.213640 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 03:47:50.213756 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.213654 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 03:47:50.214763 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.214745 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g84qt\"" Jun 05 03:47:50.214837 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.214753 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 03:47:50.267509 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267475 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-sys\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267525 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-textfile\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267552 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-tls\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267655 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267581 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-metrics-client-ca\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267653 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-wtmp\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdtc\" (UniqueName: \"kubernetes.io/projected/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-kube-api-access-7sdtc\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267736 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-accelerators-collector-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267987 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267836 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-root\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.267987 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.267870 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.346643 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.346613 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:47:50.347029 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:47:50.347004 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97f5826_da9c_4409_9c47_45d42f099b51.slice/crio-3e1063938a8a114b0fe00092058528e2971465f2d601919224bc0406e914d213 WatchSource:0}: Error finding container 3e1063938a8a114b0fe00092058528e2971465f2d601919224bc0406e914d213: Status 404 returned error can't find the container with id 3e1063938a8a114b0fe00092058528e2971465f2d601919224bc0406e914d213 Jun 05 03:47:50.362187 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.362166 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnn8d"] Jun 05 03:47:50.364698 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:47:50.364667 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f368981_12cc_4126_8dd2_5d91a6ecb2e4.slice/crio-d870cb6e0bb2a48672ee69fabbe0fd96a66ff53f1f9de56869734920b12864fc WatchSource:0}: Error finding container d870cb6e0bb2a48672ee69fabbe0fd96a66ff53f1f9de56869734920b12864fc: Status 404 returned error can't find the container with id d870cb6e0bb2a48672ee69fabbe0fd96a66ff53f1f9de56869734920b12864fc Jun 05 03:47:50.368245 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368221 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-sys\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368345 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368258 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-textfile\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368345 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368288 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-tls\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368345 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368317 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-metrics-client-ca\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368508 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368364 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-wtmp\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368508 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368388 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdtc\" (UniqueName: \"kubernetes.io/projected/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-kube-api-access-7sdtc\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368508 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368435 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-accelerators-collector-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368508 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368476 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-root\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368508 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368501 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368802 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368546 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-textfile\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368802 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368585 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-wtmp\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368802 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368710 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-sys\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.368802 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368767 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-root\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.369002 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.368900 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-metrics-client-ca\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.369195 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.369175 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-accelerators-collector-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.370571 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.370552 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-tls\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.370720 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.370703 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.377670 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.377650 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdtc\" (UniqueName: \"kubernetes.io/projected/7a37e7b7-5805-421a-b07c-cb6f665f5ae0-kube-api-access-7sdtc\") pod \"node-exporter-rvhsb\" (UID: \"7a37e7b7-5805-421a-b07c-cb6f665f5ae0\") " pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.532101 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:50.532067 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rvhsb" Jun 05 03:47:50.543529 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:47:50.543501 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a37e7b7_5805_421a_b07c_cb6f665f5ae0.slice/crio-6f2dead23ad2f9a124ae335fefd7550ead12fa6ec54d8dc924c77c506c4d963e WatchSource:0}: Error finding container 6f2dead23ad2f9a124ae335fefd7550ead12fa6ec54d8dc924c77c506c4d963e: Status 404 returned error can't find the container with id 6f2dead23ad2f9a124ae335fefd7550ead12fa6ec54d8dc924c77c506c4d963e Jun 05 03:47:51.202201 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.202162 2551 generic.go:356] "Generic (PLEG): container finished" podID="65d54707-a790-4b52-97e7-06400edbb720" containerID="290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d" exitCode=255 Jun 05 03:47:51.206748 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206701 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerDied","Data":"290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d"} Jun 05 03:47:51.206899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206762 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rvhsb" event={"ID":"7a37e7b7-5805-421a-b07c-cb6f665f5ae0","Type":"ContainerStarted","Data":"6f2dead23ad2f9a124ae335fefd7550ead12fa6ec54d8dc924c77c506c4d963e"} Jun 05 03:47:51.206899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206803 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnn8d" event={"ID":"3f368981-12cc-4126-8dd2-5d91a6ecb2e4","Type":"ContainerStarted","Data":"d870cb6e0bb2a48672ee69fabbe0fd96a66ff53f1f9de56869734920b12864fc"} Jun 05 03:47:51.206899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206831 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" event={"ID":"b97f5826-da9c-4409-9c47-45d42f099b51","Type":"ContainerStarted","Data":"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922"} Jun 05 03:47:51.206899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206847 2551 scope.go:117] "RemoveContainer" containerID="c45dbb5651f5a7f7ef2b41e305710392fce8b5ca5eb48a9f064fca2b35fcabd5" Jun 05 03:47:51.206899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.206851 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" event={"ID":"b97f5826-da9c-4409-9c47-45d42f099b51","Type":"ContainerStarted","Data":"3e1063938a8a114b0fe00092058528e2971465f2d601919224bc0406e914d213"} Jun 05 03:47:51.207146 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.207010 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:47:51.207146 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.207077 2551 scope.go:117] "RemoveContainer" containerID="290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d" Jun 05 03:47:51.207321 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:51.207295 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-c8c5d569d-vgpvh_open-cluster-management-agent-addon(65d54707-a790-4b52-97e7-06400edbb720)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" podUID="65d54707-a790-4b52-97e7-06400edbb720" Jun 05 03:47:51.209303 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.209278 2551 generic.go:356] "Generic (PLEG): container finished" podID="d84b9257-73cf-4057-bdf5-505b69980173" containerID="6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa" exitCode=1 Jun 05 03:47:51.209398 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.209321 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerDied","Data":"6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa"} Jun 05 03:47:51.209650 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.209623 2551 scope.go:117] "RemoveContainer" containerID="6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa" Jun 05 03:47:51.209811 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:51.209783 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5b88b94cd7-cwkgb_open-cluster-management-agent-addon(d84b9257-73cf-4057-bdf5-505b69980173)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podUID="d84b9257-73cf-4057-bdf5-505b69980173" Jun 05 03:47:51.231458 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.231346 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" podStartSLOduration=286.231327117 podStartE2EDuration="4m46.231327117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:51.230098805 +0000 UTC m=+286.505471876" watchObservedRunningTime="2026-06-05 03:47:51.231327117 +0000 UTC m=+286.506700189" Jun 05 03:47:51.391306 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.391278 2551 scope.go:117] "RemoveContainer" containerID="8e4ceb694b6f3379b3250635410eadca87279169a5c5cd3d797bbaf46fd5bec9" Jun 05 03:47:51.839007 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:51.838973 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:47:52.215864 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:52.215815 2551 scope.go:117] "RemoveContainer" containerID="6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa" Jun 05 03:47:52.216394 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:47:52.216046 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5b88b94cd7-cwkgb_open-cluster-management-agent-addon(d84b9257-73cf-4057-bdf5-505b69980173)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podUID="d84b9257-73cf-4057-bdf5-505b69980173" Jun 05 03:47:52.218765 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:52.218740 2551 generic.go:356] "Generic (PLEG): container finished" podID="7a37e7b7-5805-421a-b07c-cb6f665f5ae0" containerID="fef00f7356c24a60a6d4592c7b6fb4c028e7f3260aa35f35c383c074f87f26fe" exitCode=0 Jun 05 03:47:52.218888 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:52.218808 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rvhsb" event={"ID":"7a37e7b7-5805-421a-b07c-cb6f665f5ae0","Type":"ContainerDied","Data":"fef00f7356c24a60a6d4592c7b6fb4c028e7f3260aa35f35c383c074f87f26fe"} Jun 05 03:47:53.224323 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.224280 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rvhsb" event={"ID":"7a37e7b7-5805-421a-b07c-cb6f665f5ae0","Type":"ContainerStarted","Data":"ea6cda4b42e2a8d76112ed209f634308402bfaeafd12685db206679d27d996b0"} Jun 05 03:47:53.224775 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.224348 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rvhsb" event={"ID":"7a37e7b7-5805-421a-b07c-cb6f665f5ae0","Type":"ContainerStarted","Data":"95e8d7eba42fa0282bc4d015f06d3e7eacce145501e2b1f17268063b6eb87c53"} Jun 05 03:47:53.225964 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.225944 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnn8d" event={"ID":"3f368981-12cc-4126-8dd2-5d91a6ecb2e4","Type":"ContainerStarted","Data":"38b195e61b1f79f6a74a751b59da0ceae77a998f77eb78d199b290af30cd011b"} Jun 05 03:47:53.226050 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.225979 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnn8d" event={"ID":"3f368981-12cc-4126-8dd2-5d91a6ecb2e4","Type":"ContainerStarted","Data":"64396190162ac0addae673aa2f7689505dba22587688b5f5e724901c9a5cbda2"} Jun 05 03:47:53.226099 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.226084 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:47:53.268635 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.268577 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rvhsb" podStartSLOduration=2.314273964 podStartE2EDuration="3.268559944s" totalImagesPullingTime="886.432744ms" totalInitContainerRuntime="67.853236ms" isStatefulPod=true podCreationTimestamp="2026-06-05 03:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:53.246882205 +0000 UTC m=+288.522255275" watchObservedRunningTime="2026-06-05 03:47:53.268559944 +0000 UTC m=+288.543933015" Jun 05 03:47:53.269426 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:47:53.269388 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vnn8d" podStartSLOduration=251.444153237 podStartE2EDuration="4m13.269375155s" totalImagesPullingTime="1.825221918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:53.2682475 +0000 UTC m=+288.543620570" watchObservedRunningTime="2026-06-05 03:47:53.269375155 +0000 UTC m=+288.544748224" Jun 05 03:48:00.365392 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:00.365354 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" Jun 05 03:48:00.365879 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:00.365781 2551 scope.go:117] "RemoveContainer" containerID="290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d" Jun 05 03:48:00.366003 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:48:00.365980 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-c8c5d569d-vgpvh_open-cluster-management-agent-addon(65d54707-a790-4b52-97e7-06400edbb720)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" podUID="65d54707-a790-4b52-97e7-06400edbb720" Jun 05 03:48:00.375025 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:00.374997 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:48:00.375359 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:00.375345 2551 scope.go:117] "RemoveContainer" containerID="6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa" Jun 05 03:48:00.375515 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:48:00.375499 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5b88b94cd7-cwkgb_open-cluster-management-agent-addon(d84b9257-73cf-4057-bdf5-505b69980173)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" podUID="d84b9257-73cf-4057-bdf5-505b69980173" Jun 05 03:48:00.392309 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:00.392272 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" podUID="88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 03:48:02.203442 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:48:02.203390 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4v49z" podUID="0d566b68-2109-4850-a2ab-ce18c50a0ce5" Jun 05 03:48:03.232025 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:03.231995 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vnn8d" Jun 05 03:48:05.056395 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:05.056360 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:48:05.060775 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:05.060742 2551 patch_prober.go:28] interesting pod/image-registry-8cddd97cf-jjv2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 03:48:05.060922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:05.060790 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:48:05.159528 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:05.159502 2551 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 03:48:10.392194 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:10.392152 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" podUID="88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 03:48:14.201873 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:14.201842 2551 scope.go:117] "RemoveContainer" containerID="290d5f1439f6ff98a88e2648c72b8daa987cc4158a3cd24035ee326353459d9d" Jun 05 03:48:14.292339 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:14.292305 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8c5d569d-vgpvh" event={"ID":"65d54707-a790-4b52-97e7-06400edbb720","Type":"ContainerStarted","Data":"a6a44be2b2b11e41be87fa0f9af18d4a13d750b9f60a9321779b1924d4120107"} Jun 05 03:48:15.062345 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:15.062319 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:48:15.202949 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:15.202919 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:48:16.202039 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:16.202005 2551 scope.go:117] "RemoveContainer" containerID="6084b8f84b471cabc7cc74b132d83662bcca4c06f18a1bae26482b9e53f58ffa" Jun 05 03:48:16.300683 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:16.300644 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" event={"ID":"d84b9257-73cf-4057-bdf5-505b69980173","Type":"ContainerStarted","Data":"fd691b36bace29813428ca8a2d0659e61660f195c738d9066929c9fb7f764a2d"} Jun 05 03:48:16.301144 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:16.300984 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:48:16.302271 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:16.302249 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b88b94cd7-cwkgb" Jun 05 03:48:20.392930 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:20.392895 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" podUID="88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 03:48:20.393326 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:20.392958 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" Jun 05 03:48:20.393432 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:20.393405 2551 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4f2b847377b85031a752f2c295fe345c3f34b8fd7e2eee436858f5e239072200"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 05 03:48:20.393468 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:20.393452 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" podUID="88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0" containerName="service-proxy" containerID="cri-o://4f2b847377b85031a752f2c295fe345c3f34b8fd7e2eee436858f5e239072200" gracePeriod=30 Jun 05 03:48:21.318324 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:21.318287 2551 generic.go:356] "Generic (PLEG): container finished" podID="88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0" containerID="4f2b847377b85031a752f2c295fe345c3f34b8fd7e2eee436858f5e239072200" exitCode=2 Jun 05 03:48:21.318618 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:21.318360 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerDied","Data":"4f2b847377b85031a752f2c295fe345c3f34b8fd7e2eee436858f5e239072200"} Jun 05 03:48:21.318618 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:21.318409 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b79469bc5-dmd5v" event={"ID":"88b4f0e8-3da1-4dc7-9523-cc60a1c8e5a0","Type":"ContainerStarted","Data":"8cacff56e28d177e79d0e118265692d3b0b7c9f565fdda1a7b8c90c0234acc5a"} Jun 05 03:48:30.075525 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.075485 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" containerName="registry" containerID="cri-o://93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922" gracePeriod=30 Jun 05 03:48:30.322025 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.322000 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:48:30.347136 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.347047 2551 generic.go:356] "Generic (PLEG): container finished" podID="b97f5826-da9c-4409-9c47-45d42f099b51" containerID="93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922" exitCode=0 Jun 05 03:48:30.347136 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.347100 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" Jun 05 03:48:30.347322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.347144 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" event={"ID":"b97f5826-da9c-4409-9c47-45d42f099b51","Type":"ContainerDied","Data":"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922"} Jun 05 03:48:30.347322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.347190 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cddd97cf-jjv2r" event={"ID":"b97f5826-da9c-4409-9c47-45d42f099b51","Type":"ContainerDied","Data":"3e1063938a8a114b0fe00092058528e2971465f2d601919224bc0406e914d213"} Jun 05 03:48:30.347322 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.347217 2551 scope.go:117] "RemoveContainer" containerID="93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922" Jun 05 03:48:30.355239 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.355217 2551 scope.go:117] "RemoveContainer" containerID="93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922" Jun 05 03:48:30.355548 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:48:30.355529 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922\": container with ID starting with 93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922 not found: ID does not exist" containerID="93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922" Jun 05 03:48:30.355599 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.355557 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922"} err="failed to get container status \"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922\": rpc error: code = NotFound desc = could not find container \"93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922\": container with ID starting with 93058c102db19da3237247d527e674098c6ab12c0ebc9e969b6b8b450c5de922 not found: ID does not exist" Jun 05 03:48:30.467559 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467524 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467559 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467563 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7w4\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467784 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467624 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467784 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467660 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467784 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467687 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467932 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467820 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.467932 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467876 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.468042 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.467976 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates\") pod \"b97f5826-da9c-4409-9c47-45d42f099b51\" (UID: \"b97f5826-da9c-4409-9c47-45d42f099b51\") " Jun 05 03:48:30.468177 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.468151 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:30.468320 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.468275 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-trusted-ca\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.468604 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.468577 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:30.470072 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.470043 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:30.470176 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.470090 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:30.470329 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.470294 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:30.470398 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.470372 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4" (OuterVolumeSpecName: "kube-api-access-fv7w4") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "kube-api-access-fv7w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:30.470676 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.470647 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:30.476953 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.476926 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b97f5826-da9c-4409-9c47-45d42f099b51" (UID: "b97f5826-da9c-4409-9c47-45d42f099b51"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:48:30.569409 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569368 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b97f5826-da9c-4409-9c47-45d42f099b51-ca-trust-extracted\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569409 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569401 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-installation-pull-secrets\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569409 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569413 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-bound-sa-token\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569710 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569426 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b97f5826-da9c-4409-9c47-45d42f099b51-image-registry-private-configuration\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569710 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569438 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b97f5826-da9c-4409-9c47-45d42f099b51-registry-certificates\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569710 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569450 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-registry-tls\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.569710 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.569461 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7w4\" (UniqueName: \"kubernetes.io/projected/b97f5826-da9c-4409-9c47-45d42f099b51-kube-api-access-fv7w4\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:48:30.667775 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.667748 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:48:30.671639 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:30.671619 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8cddd97cf-jjv2r"] Jun 05 03:48:31.206316 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:48:31.206284 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" path="/var/lib/kubelet/pods/b97f5826-da9c-4409-9c47-45d42f099b51/volumes" Jun 05 03:49:19.301151 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.301090 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:49:19.303352 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.303330 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d566b68-2109-4850-a2ab-ce18c50a0ce5-metrics-certs\") pod \"network-metrics-daemon-4v49z\" (UID: \"0d566b68-2109-4850-a2ab-ce18c50a0ce5\") " pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:49:19.406394 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.406364 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7rr7\"" Jun 05 03:49:19.414374 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.414354 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v49z" Jun 05 03:49:19.538212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.538166 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4v49z"] Jun 05 03:49:19.541384 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:49:19.541357 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d566b68_2109_4850_a2ab_ce18c50a0ce5.slice/crio-01b5de8e4117f5d3daa4e560446e226ef7fca2f33343746860e144ed6d8b20c3 WatchSource:0}: Error finding container 01b5de8e4117f5d3daa4e560446e226ef7fca2f33343746860e144ed6d8b20c3: Status 404 returned error can't find the container with id 01b5de8e4117f5d3daa4e560446e226ef7fca2f33343746860e144ed6d8b20c3 Jun 05 03:49:19.543751 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:19.543734 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:49:20.514416 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:20.514337 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v49z" event={"ID":"0d566b68-2109-4850-a2ab-ce18c50a0ce5","Type":"ContainerStarted","Data":"f55e7dedd514fd830261fc5f92d1cf39aebd44916df98c49a2ae2dd76efa2b52"} Jun 05 03:49:20.514416 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:20.514401 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v49z" event={"ID":"0d566b68-2109-4850-a2ab-ce18c50a0ce5","Type":"ContainerStarted","Data":"01b5de8e4117f5d3daa4e560446e226ef7fca2f33343746860e144ed6d8b20c3"} Jun 05 03:49:21.519047 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:21.519013 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v49z" event={"ID":"0d566b68-2109-4850-a2ab-ce18c50a0ce5","Type":"ContainerStarted","Data":"0fd6f969972d9b3fb229bf54faed56bb127a5540c82e48d16d68f5710f830f13"} Jun 05 03:49:21.536172 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:49:21.536122 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4v49z" podStartSLOduration=375.687513022 podStartE2EDuration="6m16.536091795s" totalImagesPullingTime="848.578773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:49:21.534474969 +0000 UTC m=+376.809848051" watchObservedRunningTime="2026-06-05 03:49:21.536091795 +0000 UTC m=+376.811464861" Jun 05 03:52:17.986989 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.986957 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9"] Jun 05 03:52:17.987512 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.987190 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" containerName="registry" Jun 05 03:52:17.987512 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.987201 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" containerName="registry" Jun 05 03:52:17.987512 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.987247 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97f5826-da9c-4409-9c47-45d42f099b51" containerName="registry" Jun 05 03:52:17.989887 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.989870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:17.992423 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.992399 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7h7qs\"" Jun 05 03:52:17.992533 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.992399 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 03:52:17.993503 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.993483 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:52:17.997167 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:17.997147 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9"] Jun 05 03:52:18.133267 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.133205 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzkz\" (UniqueName: \"kubernetes.io/projected/e68d02ac-2c7c-4795-a4b5-2726ee185824-kube-api-access-bgzkz\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.133455 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.133312 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68d02ac-2c7c-4795-a4b5-2726ee185824-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.233802 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.233771 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzkz\" (UniqueName: \"kubernetes.io/projected/e68d02ac-2c7c-4795-a4b5-2726ee185824-kube-api-access-bgzkz\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.233995 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.233820 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68d02ac-2c7c-4795-a4b5-2726ee185824-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.234238 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.234221 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68d02ac-2c7c-4795-a4b5-2726ee185824-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.242457 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.242402 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzkz\" (UniqueName: \"kubernetes.io/projected/e68d02ac-2c7c-4795-a4b5-2726ee185824-kube-api-access-bgzkz\") pod \"openshift-lws-operator-fd8ccff4c-8vgw9\" (UID: \"e68d02ac-2c7c-4795-a4b5-2726ee185824\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.299248 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.299211 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" Jun 05 03:52:18.425171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:18.425123 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9"] Jun 05 03:52:18.428123 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:18.428085 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode68d02ac_2c7c_4795_a4b5_2726ee185824.slice/crio-470fd01ea5ff66fccc204fbdebc5c63b92fd225e565dcd6e6957186cef9182c6 WatchSource:0}: Error finding container 470fd01ea5ff66fccc204fbdebc5c63b92fd225e565dcd6e6957186cef9182c6: Status 404 returned error can't find the container with id 470fd01ea5ff66fccc204fbdebc5c63b92fd225e565dcd6e6957186cef9182c6 Jun 05 03:52:19.080443 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.080414 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" event={"ID":"e68d02ac-2c7c-4795-a4b5-2726ee185824","Type":"ContainerStarted","Data":"470fd01ea5ff66fccc204fbdebc5c63b92fd225e565dcd6e6957186cef9182c6"} Jun 05 03:52:19.837001 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.836960 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-lknzb"] Jun 05 03:52:19.839862 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.839843 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:19.842350 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.842324 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 03:52:19.843465 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.843441 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 03:52:19.843578 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.843489 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zpcpp\"" Jun 05 03:52:19.849155 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.849084 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lknzb"] Jun 05 03:52:19.944598 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.944541 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-bound-sa-token\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:19.944598 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:19.944606 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbfpj\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-kube-api-access-gbfpj\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.045646 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.045608 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-bound-sa-token\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.045835 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.045655 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbfpj\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-kube-api-access-gbfpj\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.053646 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.053614 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-bound-sa-token\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.053772 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.053754 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbfpj\" (UniqueName: \"kubernetes.io/projected/22d3754c-ef5b-441c-9e83-95769d80aa5f-kube-api-access-gbfpj\") pod \"cert-manager-59c77684cc-lknzb\" (UID: \"22d3754c-ef5b-441c-9e83-95769d80aa5f\") " pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.152237 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.151864 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lknzb" Jun 05 03:52:20.320839 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:20.320568 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lknzb"] Jun 05 03:52:20.324043 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:20.324004 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22d3754c_ef5b_441c_9e83_95769d80aa5f.slice/crio-d3d4ed906500bb4c5bb1b55229987124a1d0b02de83360f546946ac8950a12b7 WatchSource:0}: Error finding container d3d4ed906500bb4c5bb1b55229987124a1d0b02de83360f546946ac8950a12b7: Status 404 returned error can't find the container with id d3d4ed906500bb4c5bb1b55229987124a1d0b02de83360f546946ac8950a12b7 Jun 05 03:52:21.089342 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:21.089305 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lknzb" event={"ID":"22d3754c-ef5b-441c-9e83-95769d80aa5f","Type":"ContainerStarted","Data":"d3d4ed906500bb4c5bb1b55229987124a1d0b02de83360f546946ac8950a12b7"} Jun 05 03:52:22.095726 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:22.095686 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" event={"ID":"e68d02ac-2c7c-4795-a4b5-2726ee185824","Type":"ContainerStarted","Data":"88b4232a012fa72282ae3ee235e09624a1b6cf0fdd1fe919c612d8fe00540c91"} Jun 05 03:52:22.112730 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:22.112680 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8vgw9" podStartSLOduration=2.030696453 podStartE2EDuration="5.112663143s" totalImagesPullingTime="3.08196669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:22.111662268 +0000 UTC m=+557.387035339" watchObservedRunningTime="2026-06-05 03:52:22.112663143 +0000 UTC m=+557.388036212" Jun 05 03:52:24.104194 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:24.104160 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lknzb" event={"ID":"22d3754c-ef5b-441c-9e83-95769d80aa5f","Type":"ContainerStarted","Data":"de28def3911ea567273bf7224298fb5174ad5f04ff15c63045f5f4e0cb7683fa"} Jun 05 03:52:24.119069 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:24.119016 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-lknzb" podStartSLOduration=1.924276539 podStartE2EDuration="5.118998453s" totalImagesPullingTime="3.194721914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:24.118569193 +0000 UTC m=+559.393942265" watchObservedRunningTime="2026-06-05 03:52:24.118998453 +0000 UTC m=+559.394371523" Jun 05 03:52:37.529234 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.529198 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct"] Jun 05 03:52:37.532178 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.532162 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.534868 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.534836 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 03:52:37.534990 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.534890 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 03:52:37.534990 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.534968 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wsw82\"" Jun 05 03:52:37.535122 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.534975 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 03:52:37.535122 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.535014 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 03:52:37.549551 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.549524 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct"] Jun 05 03:52:37.570434 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.570402 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgxj\" (UniqueName: \"kubernetes.io/projected/65790009-021a-47eb-a72f-3a8a6f8acd57-kube-api-access-zxgxj\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.570578 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.570438 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.570578 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.570479 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.570578 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.570543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.570578 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.570572 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671388 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671342 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671546 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671399 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671546 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671420 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671546 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671447 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgxj\" (UniqueName: \"kubernetes.io/projected/65790009-021a-47eb-a72f-3a8a6f8acd57-kube-api-access-zxgxj\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671546 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671466 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.671949 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.671928 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.673743 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.673717 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65790009-021a-47eb-a72f-3a8a6f8acd57-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.673944 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.673925 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.673985 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.673952 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65790009-021a-47eb-a72f-3a8a6f8acd57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.682250 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.682227 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgxj\" (UniqueName: \"kubernetes.io/projected/65790009-021a-47eb-a72f-3a8a6f8acd57-kube-api-access-zxgxj\") pod \"opendatahub-operator-controller-manager-589666b55-lzdct\" (UID: \"65790009-021a-47eb-a72f-3a8a6f8acd57\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.842185 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.842074 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:37.976372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:37.976341 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct"] Jun 05 03:52:37.979988 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:37.979954 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65790009_021a_47eb_a72f_3a8a6f8acd57.slice/crio-478790c3ab0b70bf7bf59e3e8fca70edd13376576c9667b8ef709bda823e8387 WatchSource:0}: Error finding container 478790c3ab0b70bf7bf59e3e8fca70edd13376576c9667b8ef709bda823e8387: Status 404 returned error can't find the container with id 478790c3ab0b70bf7bf59e3e8fca70edd13376576c9667b8ef709bda823e8387 Jun 05 03:52:38.151935 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:38.151852 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" event={"ID":"65790009-021a-47eb-a72f-3a8a6f8acd57","Type":"ContainerStarted","Data":"478790c3ab0b70bf7bf59e3e8fca70edd13376576c9667b8ef709bda823e8387"} Jun 05 03:52:41.165254 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:41.165176 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" event={"ID":"65790009-021a-47eb-a72f-3a8a6f8acd57","Type":"ContainerStarted","Data":"dd604ba6945c779aa224667c5787e91c9bc4b18e8bd2940f83502b322a977db8"} Jun 05 03:52:42.174784 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:42.174726 2551 generic.go:356] "Generic (PLEG): container finished" podID="65790009-021a-47eb-a72f-3a8a6f8acd57" containerID="dd604ba6945c779aa224667c5787e91c9bc4b18e8bd2940f83502b322a977db8" exitCode=0 Jun 05 03:52:42.175186 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:42.174798 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" event={"ID":"65790009-021a-47eb-a72f-3a8a6f8acd57","Type":"ContainerDied","Data":"dd604ba6945c779aa224667c5787e91c9bc4b18e8bd2940f83502b322a977db8"} Jun 05 03:52:43.180469 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:43.180433 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" event={"ID":"65790009-021a-47eb-a72f-3a8a6f8acd57","Type":"ContainerStarted","Data":"29bc31eb7b66ab56e800a3ebafa284a1b18366404c315570baba0abbbda062e2"} Jun 05 03:52:43.180920 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:43.180543 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:43.200446 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:43.200385 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" podStartSLOduration=2.024559734 podStartE2EDuration="6.200366186s" totalImagesPullingTime="3.192107391s" totalInitContainerRuntime="983.699061ms" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:43.198999975 +0000 UTC m=+578.474373046" watchObservedRunningTime="2026-06-05 03:52:43.200366186 +0000 UTC m=+578.475739255" Jun 05 03:52:54.187204 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:54.187167 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-lzdct" Jun 05 03:52:56.472072 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.472029 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm"] Jun 05 03:52:56.488625 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.488588 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm"] Jun 05 03:52:56.488786 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.488724 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.491450 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.491427 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 03:52:56.491561 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.491460 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 03:52:56.492517 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.492501 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 03:52:56.492590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.492556 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2rh8x\"" Jun 05 03:52:56.492590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.492564 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 03:52:56.569007 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.568970 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ldpvn"] Jun 05 03:52:56.593943 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.593912 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ldpvn"] Jun 05 03:52:56.594190 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.594089 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.596616 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.596592 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 03:52:56.596866 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.596848 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-k5z7j\"" Jun 05 03:52:56.612120 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.612078 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxp2\" (UniqueName: \"kubernetes.io/projected/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-kube-api-access-5hxp2\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.612244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.612164 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tls-certs\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.612244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.612210 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tmp\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.713279 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.713248 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tls-certs\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.713279 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.713290 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tmp\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.713509 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.713316 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.713509 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.713354 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhwf\" (UniqueName: \"kubernetes.io/projected/44a97407-59ae-4a62-b2d4-383fd78547f6-kube-api-access-mwhwf\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.713509 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.713403 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxp2\" (UniqueName: \"kubernetes.io/projected/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-kube-api-access-5hxp2\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.715528 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.715503 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tmp\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.715734 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.715715 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-tls-certs\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.721374 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.721348 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxp2\" (UniqueName: \"kubernetes.io/projected/9ef10785-ac21-426b-b187-fa0a3ac4bdc9-kube-api-access-5hxp2\") pod \"kube-auth-proxy-7ddd7d4874-llmgm\" (UID: \"9ef10785-ac21-426b-b187-fa0a3ac4bdc9\") " pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.799312 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.799276 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" Jun 05 03:52:56.814533 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.814507 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.814679 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.814557 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhwf\" (UniqueName: \"kubernetes.io/projected/44a97407-59ae-4a62-b2d4-383fd78547f6-kube-api-access-mwhwf\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.814679 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:52:56.814665 2551 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 03:52:56.814782 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:52:56.814730 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert podName:44a97407-59ae-4a62-b2d4-383fd78547f6 nodeName:}" failed. No retries permitted until 2026-06-05 03:52:57.314715188 +0000 UTC m=+592.590088236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert") pod "odh-model-controller-6dc94f689f-ldpvn" (UID: "44a97407-59ae-4a62-b2d4-383fd78547f6") : secret "odh-model-controller-webhook-cert" not found Jun 05 03:52:56.831504 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.831476 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhwf\" (UniqueName: \"kubernetes.io/projected/44a97407-59ae-4a62-b2d4-383fd78547f6-kube-api-access-mwhwf\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:56.957328 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:56.957299 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm"] Jun 05 03:52:56.959662 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:56.959629 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef10785_ac21_426b_b187_fa0a3ac4bdc9.slice/crio-6a970a6230e2e487ef286f555356f2d8a79cc4b295ef6b08e8aaa6ed94fb5976 WatchSource:0}: Error finding container 6a970a6230e2e487ef286f555356f2d8a79cc4b295ef6b08e8aaa6ed94fb5976: Status 404 returned error can't find the container with id 6a970a6230e2e487ef286f555356f2d8a79cc4b295ef6b08e8aaa6ed94fb5976 Jun 05 03:52:57.231149 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.231054 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-k62pg"] Jun 05 03:52:57.265674 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.265630 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" event={"ID":"9ef10785-ac21-426b-b187-fa0a3ac4bdc9","Type":"ContainerStarted","Data":"6a970a6230e2e487ef286f555356f2d8a79cc4b295ef6b08e8aaa6ed94fb5976"} Jun 05 03:52:57.265674 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.265672 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-k62pg"] Jun 05 03:52:57.265922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.265760 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.268318 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.268296 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-h2kts\"" Jun 05 03:52:57.268445 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.268341 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 03:52:57.319098 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.319058 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:57.319324 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.319130 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6l6b\" (UniqueName: \"kubernetes.io/projected/3ec9978c-ecfe-40cd-ab19-8049854d66a9-kube-api-access-n6l6b\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.319324 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.319184 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec9978c-ecfe-40cd-ab19-8049854d66a9-tls-certs\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.321687 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.321657 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44a97407-59ae-4a62-b2d4-383fd78547f6-cert\") pod \"odh-model-controller-6dc94f689f-ldpvn\" (UID: \"44a97407-59ae-4a62-b2d4-383fd78547f6\") " pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:57.420278 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.420245 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec9978c-ecfe-40cd-ab19-8049854d66a9-tls-certs\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.420474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.420313 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6l6b\" (UniqueName: \"kubernetes.io/projected/3ec9978c-ecfe-40cd-ab19-8049854d66a9-kube-api-access-n6l6b\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.422711 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.422691 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec9978c-ecfe-40cd-ab19-8049854d66a9-tls-certs\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.428449 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.428429 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6l6b\" (UniqueName: \"kubernetes.io/projected/3ec9978c-ecfe-40cd-ab19-8049854d66a9-kube-api-access-n6l6b\") pod \"model-serving-api-5dd488fc48-k62pg\" (UID: \"3ec9978c-ecfe-40cd-ab19-8049854d66a9\") " pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.506169 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.506062 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:52:57.576042 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.576002 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:52:57.658269 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.658130 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ldpvn"] Jun 05 03:52:57.662682 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:57.662636 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a97407_59ae_4a62_b2d4_383fd78547f6.slice/crio-7e227301fdfa92cd1ca293281797365970ac8b338ac4530041544e7fd483fe7a WatchSource:0}: Error finding container 7e227301fdfa92cd1ca293281797365970ac8b338ac4530041544e7fd483fe7a: Status 404 returned error can't find the container with id 7e227301fdfa92cd1ca293281797365970ac8b338ac4530041544e7fd483fe7a Jun 05 03:52:57.752832 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:57.752792 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-k62pg"] Jun 05 03:52:57.757356 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:52:57.757273 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec9978c_ecfe_40cd_ab19_8049854d66a9.slice/crio-6026018243c06d198f87256ca5e8456aae590b9832db06bd7779555b768bdb7b WatchSource:0}: Error finding container 6026018243c06d198f87256ca5e8456aae590b9832db06bd7779555b768bdb7b: Status 404 returned error can't find the container with id 6026018243c06d198f87256ca5e8456aae590b9832db06bd7779555b768bdb7b Jun 05 03:52:58.238827 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:58.238281 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" event={"ID":"3ec9978c-ecfe-40cd-ab19-8049854d66a9","Type":"ContainerStarted","Data":"6026018243c06d198f87256ca5e8456aae590b9832db06bd7779555b768bdb7b"} Jun 05 03:52:58.241026 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:52:58.240875 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" event={"ID":"44a97407-59ae-4a62-b2d4-383fd78547f6","Type":"ContainerStarted","Data":"7e227301fdfa92cd1ca293281797365970ac8b338ac4530041544e7fd483fe7a"} Jun 05 03:53:02.270270 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.270190 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" event={"ID":"9ef10785-ac21-426b-b187-fa0a3ac4bdc9","Type":"ContainerStarted","Data":"48d377ea81cbce58b98555f54a9fbeea358dad1f2ea0a19ee9c51a01fda00b04"} Jun 05 03:53:02.272939 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.272423 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" event={"ID":"3ec9978c-ecfe-40cd-ab19-8049854d66a9","Type":"ContainerStarted","Data":"e2841fcd69f31e1b5fcbdff5b341054f8183dfe34b5ee9bf1c3e5eadf0fb9535"} Jun 05 03:53:02.272939 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.272891 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:53:02.275391 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.275326 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" event={"ID":"44a97407-59ae-4a62-b2d4-383fd78547f6","Type":"ContainerStarted","Data":"74b75097c58e9804a7f22e377054ebb3b706e532a50b4904bf7dbe440bb343ca"} Jun 05 03:53:02.275525 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.275468 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:53:02.286039 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.285988 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ddd7d4874-llmgm" podStartSLOduration=1.0890745609999999 podStartE2EDuration="6.285972464s" totalImagesPullingTime="5.196897903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:02.28528741 +0000 UTC m=+597.560660480" watchObservedRunningTime="2026-06-05 03:53:02.285972464 +0000 UTC m=+597.561345534" Jun 05 03:53:02.301846 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.301767 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" podStartSLOduration=0.89714479 podStartE2EDuration="5.301748678s" totalImagesPullingTime="4.404603888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:02.300151491 +0000 UTC m=+597.575524562" watchObservedRunningTime="2026-06-05 03:53:02.301748678 +0000 UTC m=+597.577121753" Jun 05 03:53:02.316150 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:02.316092 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" podStartSLOduration=1.8160135 podStartE2EDuration="6.316077695s" totalImagesPullingTime="4.500064195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:02.314944231 +0000 UTC m=+597.590317302" watchObservedRunningTime="2026-06-05 03:53:02.316077695 +0000 UTC m=+597.591450780" Jun 05 03:53:07.313162 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.313125 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mbvkm"] Jun 05 03:53:07.317687 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.317665 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.320372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.320352 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 03:53:07.320489 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.320353 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-58lc8\"" Jun 05 03:53:07.327730 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.327703 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mbvkm"] Jun 05 03:53:07.330789 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.330768 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8"] Jun 05 03:53:07.333879 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.333858 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:07.337242 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.337223 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-99fqh\"" Jun 05 03:53:07.337377 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.337356 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 03:53:07.344820 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.344788 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8"] Jun 05 03:53:07.410074 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.410032 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:07.410292 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.410137 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.410292 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.410182 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxtl9\" (UniqueName: \"kubernetes.io/projected/65806521-1be0-4d25-b6b3-93361d47385b-kube-api-access-cxtl9\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:07.410292 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.410207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjl2j\" (UniqueName: \"kubernetes.io/projected/8e6c8aab-bc0b-4135-967b-b65109eaaa43-kube-api-access-vjl2j\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.511082 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.511050 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxtl9\" (UniqueName: \"kubernetes.io/projected/65806521-1be0-4d25-b6b3-93361d47385b-kube-api-access-cxtl9\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:07.511082 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.511083 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjl2j\" (UniqueName: \"kubernetes.io/projected/8e6c8aab-bc0b-4135-967b-b65109eaaa43-kube-api-access-vjl2j\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.511351 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.511331 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:07.511456 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.511433 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.511523 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:53:07.511452 2551 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 03:53:07.511523 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:53:07.511516 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert podName:65806521-1be0-4d25-b6b3-93361d47385b nodeName:}" failed. No retries permitted until 2026-06-05 03:53:08.011500156 +0000 UTC m=+603.286873204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert") pod "llmisvc-controller-manager-864bfd7bc9-cf2p8" (UID: "65806521-1be0-4d25-b6b3-93361d47385b") : secret "llmisvc-webhook-server-cert" not found Jun 05 03:53:07.511623 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:53:07.511536 2551 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 05 03:53:07.511623 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:53:07.511586 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert podName:8e6c8aab-bc0b-4135-967b-b65109eaaa43 nodeName:}" failed. No retries permitted until 2026-06-05 03:53:08.011569403 +0000 UTC m=+603.286942457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert") pod "kserve-controller-manager-69fc866d76-mbvkm" (UID: "8e6c8aab-bc0b-4135-967b-b65109eaaa43") : secret "kserve-webhook-server-cert" not found Jun 05 03:53:07.535501 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.535470 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjl2j\" (UniqueName: \"kubernetes.io/projected/8e6c8aab-bc0b-4135-967b-b65109eaaa43-kube-api-access-vjl2j\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:07.535713 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:07.535693 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxtl9\" (UniqueName: \"kubernetes.io/projected/65806521-1be0-4d25-b6b3-93361d47385b-kube-api-access-cxtl9\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:08.015725 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.015687 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:08.015934 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.015748 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:08.018264 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.018236 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65806521-1be0-4d25-b6b3-93361d47385b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cf2p8\" (UID: \"65806521-1be0-4d25-b6b3-93361d47385b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:08.018380 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.018236 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6c8aab-bc0b-4135-967b-b65109eaaa43-cert\") pod \"kserve-controller-manager-69fc866d76-mbvkm\" (UID: \"8e6c8aab-bc0b-4135-967b-b65109eaaa43\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:08.228022 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.227978 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:08.244635 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.244608 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:08.369545 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.369519 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mbvkm"] Jun 05 03:53:08.371773 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:53:08.371747 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6c8aab_bc0b_4135_967b_b65109eaaa43.slice/crio-146a653212ce45213fe53a6519fc7c1c0dc688f55408e435bb36b7dbf21d21cd WatchSource:0}: Error finding container 146a653212ce45213fe53a6519fc7c1c0dc688f55408e435bb36b7dbf21d21cd: Status 404 returned error can't find the container with id 146a653212ce45213fe53a6519fc7c1c0dc688f55408e435bb36b7dbf21d21cd Jun 05 03:53:08.387812 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:08.387783 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8"] Jun 05 03:53:08.389991 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:53:08.389963 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65806521_1be0_4d25_b6b3_93361d47385b.slice/crio-0b2a406314ccf9bca87fb72e37167f8eb2fb701d4aaaa09d50ca95289a0b0f42 WatchSource:0}: Error finding container 0b2a406314ccf9bca87fb72e37167f8eb2fb701d4aaaa09d50ca95289a0b0f42: Status 404 returned error can't find the container with id 0b2a406314ccf9bca87fb72e37167f8eb2fb701d4aaaa09d50ca95289a0b0f42 Jun 05 03:53:09.311904 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:09.311840 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" event={"ID":"8e6c8aab-bc0b-4135-967b-b65109eaaa43","Type":"ContainerStarted","Data":"146a653212ce45213fe53a6519fc7c1c0dc688f55408e435bb36b7dbf21d21cd"} Jun 05 03:53:09.313169 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:09.313135 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" event={"ID":"65806521-1be0-4d25-b6b3-93361d47385b","Type":"ContainerStarted","Data":"0b2a406314ccf9bca87fb72e37167f8eb2fb701d4aaaa09d50ca95289a0b0f42"} Jun 05 03:53:11.324273 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:11.324232 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" event={"ID":"8e6c8aab-bc0b-4135-967b-b65109eaaa43","Type":"ContainerStarted","Data":"22572d390c72a2648315312b42aed731b52463bd0e4961b9a39357a4b3af9ef4"} Jun 05 03:53:11.324769 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:11.324321 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:11.406437 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:11.406374 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" podStartSLOduration=1.922102687 podStartE2EDuration="4.406352357s" totalImagesPullingTime="2.48424967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:11.404902347 +0000 UTC m=+606.680275420" watchObservedRunningTime="2026-06-05 03:53:11.406352357 +0000 UTC m=+606.681725429" Jun 05 03:53:12.329928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:12.329892 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" event={"ID":"65806521-1be0-4d25-b6b3-93361d47385b","Type":"ContainerStarted","Data":"f674a32fb7bf14f3af0279d1f7c71d6ff9756d4f2836a196271875964dcc1449"} Jun 05 03:53:12.330383 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:12.330171 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:53:12.349814 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:12.349753 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" podStartSLOduration=2.204849188 podStartE2EDuration="5.349697885s" totalImagesPullingTime="3.144848697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:12.348223847 +0000 UTC m=+607.623596920" watchObservedRunningTime="2026-06-05 03:53:12.349697885 +0000 UTC m=+607.625070954" Jun 05 03:53:13.282071 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.282043 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-ldpvn" Jun 05 03:53:13.637465 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.637381 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-p2wvv"] Jun 05 03:53:13.640638 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.640616 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.643598 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.643563 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-stws6\"" Jun 05 03:53:13.644038 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.644020 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 03:53:13.653083 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.653059 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-p2wvv"] Jun 05 03:53:13.768799 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.768767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8c070297-19ce-4e02-a327-dbc171506ab4-redirect-config\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.769005 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.768852 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvctq\" (UniqueName: \"kubernetes.io/projected/8c070297-19ce-4e02-a327-dbc171506ab4-kube-api-access-bvctq\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.869869 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.869831 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8c070297-19ce-4e02-a327-dbc171506ab4-redirect-config\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.870028 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.869930 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvctq\" (UniqueName: \"kubernetes.io/projected/8c070297-19ce-4e02-a327-dbc171506ab4-kube-api-access-bvctq\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.870621 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.870601 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8c070297-19ce-4e02-a327-dbc171506ab4-redirect-config\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.880789 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.880755 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvctq\" (UniqueName: \"kubernetes.io/projected/8c070297-19ce-4e02-a327-dbc171506ab4-kube-api-access-bvctq\") pod \"dashboard-redirect-ccfd96f5-p2wvv\" (UID: \"8c070297-19ce-4e02-a327-dbc171506ab4\") " pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:13.950673 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:13.950584 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" Jun 05 03:53:14.109261 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.109220 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-p2wvv"] Jun 05 03:53:14.112301 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:53:14.112274 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c070297_19ce_4e02_a327_dbc171506ab4.slice/crio-905075f5d59b1d0488084a5e28d7126d2e95816b30fdeb384d7dbf52d8668281 WatchSource:0}: Error finding container 905075f5d59b1d0488084a5e28d7126d2e95816b30fdeb384d7dbf52d8668281: Status 404 returned error can't find the container with id 905075f5d59b1d0488084a5e28d7126d2e95816b30fdeb384d7dbf52d8668281 Jun 05 03:53:14.287961 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.287935 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-k62pg" Jun 05 03:53:14.317883 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.317850 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f"] Jun 05 03:53:14.322281 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.322262 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.325217 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.325196 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 03:53:14.325318 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.325238 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 03:53:14.325462 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.325450 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xlgsp\"" Jun 05 03:53:14.342653 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.342618 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" event={"ID":"8c070297-19ce-4e02-a327-dbc171506ab4","Type":"ContainerStarted","Data":"905075f5d59b1d0488084a5e28d7126d2e95816b30fdeb384d7dbf52d8668281"} Jun 05 03:53:14.344459 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.344435 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f"] Jun 05 03:53:14.373919 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.373887 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5130970b-c899-4c19-8390-183cdb884de4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.374082 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.374044 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twtql\" (UniqueName: \"kubernetes.io/projected/5130970b-c899-4c19-8390-183cdb884de4-kube-api-access-twtql\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.474468 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.474426 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5130970b-c899-4c19-8390-183cdb884de4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.474646 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.474476 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twtql\" (UniqueName: \"kubernetes.io/projected/5130970b-c899-4c19-8390-183cdb884de4-kube-api-access-twtql\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.477101 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.477072 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5130970b-c899-4c19-8390-183cdb884de4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.483166 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.483134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twtql\" (UniqueName: \"kubernetes.io/projected/5130970b-c899-4c19-8390-183cdb884de4-kube-api-access-twtql\") pod \"servicemesh-operator3-57f65f65fb-sgw7f\" (UID: \"5130970b-c899-4c19-8390-183cdb884de4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.632671 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.632584 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:14.784619 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:14.784596 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f"] Jun 05 03:53:14.786891 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:53:14.786864 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5130970b_c899_4c19_8390_183cdb884de4.slice/crio-1a2cb925d76993dea4adaede731b57dec14d3abe1cb244ebe2bdef9bd902c85e WatchSource:0}: Error finding container 1a2cb925d76993dea4adaede731b57dec14d3abe1cb244ebe2bdef9bd902c85e: Status 404 returned error can't find the container with id 1a2cb925d76993dea4adaede731b57dec14d3abe1cb244ebe2bdef9bd902c85e Jun 05 03:53:15.347649 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:15.347614 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" event={"ID":"5130970b-c899-4c19-8390-183cdb884de4","Type":"ContainerStarted","Data":"1a2cb925d76993dea4adaede731b57dec14d3abe1cb244ebe2bdef9bd902c85e"} Jun 05 03:53:18.363913 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:18.363878 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" event={"ID":"5130970b-c899-4c19-8390-183cdb884de4","Type":"ContainerStarted","Data":"179bfd518e9fc90301b02659fe303d85f8fae2ce8f6ed6ff447219b26054a59f"} Jun 05 03:53:18.364415 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:18.363969 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:18.386484 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:18.386425 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" podStartSLOduration=1.412916294 podStartE2EDuration="4.386403344s" totalImagesPullingTime="2.97348705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:18.384474103 +0000 UTC m=+613.659847164" watchObservedRunningTime="2026-06-05 03:53:18.386403344 +0000 UTC m=+613.661776416" Jun 05 03:53:21.349952 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.349919 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q"] Jun 05 03:53:21.354370 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.354351 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.357355 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.357331 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 03:53:21.357487 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.357460 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 03:53:21.357642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.357545 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 03:53:21.357642 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.357554 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 03:53:21.357783 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.357767 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-629cc\"" Jun 05 03:53:21.366201 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.366178 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q"] Jun 05 03:53:21.380567 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.380538 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" event={"ID":"8c070297-19ce-4e02-a327-dbc171506ab4","Type":"ContainerStarted","Data":"4637393603ad6246751076102ef438059c00ce1f405bbaa58d133e1631857c45"} Jun 05 03:53:21.402648 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.402602 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-ccfd96f5-p2wvv" podStartSLOduration=1.240769553 podStartE2EDuration="8.402587684s" totalImagesPullingTime="7.161818131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:21.401947284 +0000 UTC m=+616.677320357" watchObservedRunningTime="2026-06-05 03:53:21.402587684 +0000 UTC m=+616.677960753" Jun 05 03:53:21.436729 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436699 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.436873 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436756 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.436873 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436801 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.436873 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436820 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qvvm\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-kube-api-access-8qvvm\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.436873 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436860 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee60dd12-ba19-4451-a6c1-3029586a3c01-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.437003 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.437003 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.436909 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.537468 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537386 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.537468 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537446 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.537695 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537605 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.537695 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537641 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.537695 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537669 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qvvm\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-kube-api-access-8qvvm\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.538064 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537708 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee60dd12-ba19-4451-a6c1-3029586a3c01-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.538064 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.537732 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.538217 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.538069 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.540137 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.540098 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.540392 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.540372 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee60dd12-ba19-4451-a6c1-3029586a3c01-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.540462 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.540400 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.540501 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.540490 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.545081 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.545059 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.545275 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.545257 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qvvm\" (UniqueName: \"kubernetes.io/projected/ee60dd12-ba19-4451-a6c1-3029586a3c01-kube-api-access-8qvvm\") pod \"istiod-openshift-gateway-75c67f8887-6xd7q\" (UID: \"ee60dd12-ba19-4451-a6c1-3029586a3c01\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.664999 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.664962 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:21.809090 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:21.809005 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q"] Jun 05 03:53:21.811145 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:53:21.811117 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee60dd12_ba19_4451_a6c1_3029586a3c01.slice/crio-a327fb79d5e6b3a88d936fffb9d4290769b94a13b5b642a24546244a530a3518 WatchSource:0}: Error finding container a327fb79d5e6b3a88d936fffb9d4290769b94a13b5b642a24546244a530a3518: Status 404 returned error can't find the container with id a327fb79d5e6b3a88d936fffb9d4290769b94a13b5b642a24546244a530a3518 Jun 05 03:53:22.390201 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:22.390161 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" event={"ID":"ee60dd12-ba19-4451-a6c1-3029586a3c01","Type":"ContainerStarted","Data":"a327fb79d5e6b3a88d936fffb9d4290769b94a13b5b642a24546244a530a3518"} Jun 05 03:53:24.258240 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:24.258193 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:53:24.258603 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:24.258265 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:53:24.401321 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:24.401240 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" event={"ID":"ee60dd12-ba19-4451-a6c1-3029586a3c01","Type":"ContainerStarted","Data":"3cddcece4bceb4151d0641efbfbf1eaf9f4b27bfa28e9d8c3ea7b3c7d1b76a6c"} Jun 05 03:53:24.401514 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:24.401493 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:24.422346 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:24.422299 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" podStartSLOduration=0.977559645 podStartE2EDuration="3.422283316s" totalImagesPullingTime="2.444723671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:24.420352635 +0000 UTC m=+619.695725731" watchObservedRunningTime="2026-06-05 03:53:24.422283316 +0000 UTC m=+619.697656387" Jun 05 03:53:25.407915 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:25.407878 2551 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-6xd7q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 03:53:25.408411 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:25.407949 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" podUID="ee60dd12-ba19-4451-a6c1-3029586a3c01" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:53:28.406388 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:28.406356 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xd7q" Jun 05 03:53:29.370935 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:29.370902 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgw7f" Jun 05 03:53:42.335418 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:42.335383 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mbvkm" Jun 05 03:53:43.337913 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:53:43.337880 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cf2p8" Jun 05 03:54:35.186212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.186175 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl"] Jun 05 03:54:35.189351 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.189335 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:35.192314 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.192293 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6bz6m\"" Jun 05 03:54:35.192668 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.192650 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 03:54:35.193424 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.193404 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 03:54:35.193501 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.193407 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 03:54:35.210358 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.210334 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl"] Jun 05 03:54:35.320742 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.320706 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dx2\" (UniqueName: \"kubernetes.io/projected/cf6338d6-362f-4a1e-98d7-230f74eec7ba-kube-api-access-h8dx2\") pod \"dns-operator-controller-manager-864dd78c4c-x4qtl\" (UID: \"cf6338d6-362f-4a1e-98d7-230f74eec7ba\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:35.421656 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.421612 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dx2\" (UniqueName: \"kubernetes.io/projected/cf6338d6-362f-4a1e-98d7-230f74eec7ba-kube-api-access-h8dx2\") pod \"dns-operator-controller-manager-864dd78c4c-x4qtl\" (UID: \"cf6338d6-362f-4a1e-98d7-230f74eec7ba\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:35.429990 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.429954 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dx2\" (UniqueName: \"kubernetes.io/projected/cf6338d6-362f-4a1e-98d7-230f74eec7ba-kube-api-access-h8dx2\") pod \"dns-operator-controller-manager-864dd78c4c-x4qtl\" (UID: \"cf6338d6-362f-4a1e-98d7-230f74eec7ba\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:35.499089 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.498999 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:35.623572 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.623541 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl"] Jun 05 03:54:35.626695 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:54:35.626670 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6338d6_362f_4a1e_98d7_230f74eec7ba.slice/crio-dcf9e601d0dfc39f547670199538bcff91be9b871a72e79824fe9ebe3c156588 WatchSource:0}: Error finding container dcf9e601d0dfc39f547670199538bcff91be9b871a72e79824fe9ebe3c156588: Status 404 returned error can't find the container with id dcf9e601d0dfc39f547670199538bcff91be9b871a72e79824fe9ebe3c156588 Jun 05 03:54:35.628725 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.628707 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:54:35.709569 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:35.709537 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" event={"ID":"cf6338d6-362f-4a1e-98d7-230f74eec7ba","Type":"ContainerStarted","Data":"dcf9e601d0dfc39f547670199538bcff91be9b871a72e79824fe9ebe3c156588"} Jun 05 03:54:37.721252 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:37.721153 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" event={"ID":"cf6338d6-362f-4a1e-98d7-230f74eec7ba","Type":"ContainerStarted","Data":"28a719ec37be90abfc2eef6a5394737e53e62fd32f258a17e475ec85e2b0a8e1"} Jun 05 03:54:37.721625 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:37.721297 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:37.749706 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:37.749645 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" podStartSLOduration=0.908567176 podStartE2EDuration="2.749625929s" totalImagesPullingTime="1.841058753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:37.748203263 +0000 UTC m=+693.023576334" watchObservedRunningTime="2026-06-05 03:54:37.749625929 +0000 UTC m=+693.024998998" Jun 05 03:54:48.728045 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:48.728011 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x4qtl" Jun 05 03:54:50.172361 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.172331 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6"] Jun 05 03:54:50.175790 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.175767 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.178343 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.178327 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-c94xh\"" Jun 05 03:54:50.187877 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.187849 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6"] Jun 05 03:54:50.244209 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.244171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqmv\" (UniqueName: \"kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.244209 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.244207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.265943 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.265912 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6"] Jun 05 03:54:50.266186 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:54:50.266167 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jnqmv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" Jun 05 03:54:50.345372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.345339 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqmv\" (UniqueName: \"kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.345372 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.345374 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.345746 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.345730 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.356523 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.356495 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqmv\" (UniqueName: \"kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.730263 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.730227 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6"] Jun 05 03:54:50.742615 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.742582 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6"] Jun 05 03:54:50.775277 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.775248 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.778006 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:54:50.777968 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" is forbidden: User \"system:node:ip-10-0-139-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-39.ec2.internal' and this object" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.782486 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.782459 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:54:50.782603 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.782552 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.784733 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:54:50.784710 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" is forbidden: User \"system:node:ip-10-0-139-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-39.ec2.internal' and this object" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.785573 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.785558 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.799826 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.799774 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:54:50.812666 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:54:50.812625 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" is forbidden: User \"system:node:ip-10-0-139-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-39.ec2.internal' and this object" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:50.848843 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.848815 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnqmv\" (UniqueName: \"kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv\") pod \"8714795a-e3e8-44ed-84b7-dd96f045268c\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " Jun 05 03:54:50.849018 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.848900 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume\") pod \"8714795a-e3e8-44ed-84b7-dd96f045268c\" (UID: \"8714795a-e3e8-44ed-84b7-dd96f045268c\") " Jun 05 03:54:50.849018 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.848989 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76s66\" (UniqueName: \"kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.849175 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.849037 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.849221 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.849188 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8714795a-e3e8-44ed-84b7-dd96f045268c" (UID: "8714795a-e3e8-44ed-84b7-dd96f045268c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:50.850907 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.850883 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv" (OuterVolumeSpecName: "kube-api-access-jnqmv") pod "8714795a-e3e8-44ed-84b7-dd96f045268c" (UID: "8714795a-e3e8-44ed-84b7-dd96f045268c"). InnerVolumeSpecName "kube-api-access-jnqmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:50.950167 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.950101 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76s66\" (UniqueName: \"kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.950371 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.950184 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.950371 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.950232 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnqmv\" (UniqueName: \"kubernetes.io/projected/8714795a-e3e8-44ed-84b7-dd96f045268c-kube-api-access-jnqmv\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:54:50.950371 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.950243 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8714795a-e3e8-44ed-84b7-dd96f045268c-extensions-socket-volume\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:54:50.950554 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.950533 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:50.964041 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:50.964009 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76s66\" (UniqueName: \"kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zwm\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:51.095591 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:51.095554 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:51.207880 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:51.207850 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" path="/var/lib/kubelet/pods/8714795a-e3e8-44ed-84b7-dd96f045268c/volumes" Jun 05 03:54:51.230513 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:51.230489 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:54:51.233856 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:54:51.233833 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef856eb5_f851_48ff_ae25_8f56b78f231e.slice/crio-6f30b5db36b22d0c69f94cf7cc48bf2e9ceb88aa914ba927b42b6c77495486eb WatchSource:0}: Error finding container 6f30b5db36b22d0c69f94cf7cc48bf2e9ceb88aa914ba927b42b6c77495486eb: Status 404 returned error can't find the container with id 6f30b5db36b22d0c69f94cf7cc48bf2e9ceb88aa914ba927b42b6c77495486eb Jun 05 03:54:51.781443 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:51.781395 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" event={"ID":"ef856eb5-f851-48ff-ae25-8f56b78f231e","Type":"ContainerStarted","Data":"6f30b5db36b22d0c69f94cf7cc48bf2e9ceb88aa914ba927b42b6c77495486eb"} Jun 05 03:54:51.781587 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:51.781454 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:51.786600 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:54:51.786571 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pvrc6\" is forbidden: User \"system:node:ip-10-0-139-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-39.ec2.internal' and this object" podUID="8714795a-e3e8-44ed-84b7-dd96f045268c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pvrc6" Jun 05 03:54:55.808538 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:55.808494 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" event={"ID":"ef856eb5-f851-48ff-ae25-8f56b78f231e","Type":"ContainerStarted","Data":"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01"} Jun 05 03:54:55.808932 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:55.808635 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:54:55.829608 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:54:55.829557 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" podStartSLOduration=2.198285313 podStartE2EDuration="5.829541574s" totalImagesPullingTime="3.631256261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:55.826781944 +0000 UTC m=+711.102155013" watchObservedRunningTime="2026-06-05 03:54:55.829541574 +0000 UTC m=+711.104914644" Jun 05 03:55:03.228442 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.228392 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:55:03.229035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.228647 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" podUID="ef856eb5-f851-48ff-ae25-8f56b78f231e" containerName="manager" containerID="cri-o://3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01" gracePeriod=10 Jun 05 03:55:03.230547 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.230527 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:55:03.477290 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.477264 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:55:03.546927 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.546897 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76s66\" (UniqueName: \"kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66\") pod \"ef856eb5-f851-48ff-ae25-8f56b78f231e\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " Jun 05 03:55:03.547093 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.546984 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume\") pod \"ef856eb5-f851-48ff-ae25-8f56b78f231e\" (UID: \"ef856eb5-f851-48ff-ae25-8f56b78f231e\") " Jun 05 03:55:03.547507 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.547486 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef856eb5-f851-48ff-ae25-8f56b78f231e" (UID: "ef856eb5-f851-48ff-ae25-8f56b78f231e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:55:03.549066 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.549045 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66" (OuterVolumeSpecName: "kube-api-access-76s66") pod "ef856eb5-f851-48ff-ae25-8f56b78f231e" (UID: "ef856eb5-f851-48ff-ae25-8f56b78f231e"). InnerVolumeSpecName "kube-api-access-76s66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:55:03.648045 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.648010 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76s66\" (UniqueName: \"kubernetes.io/projected/ef856eb5-f851-48ff-ae25-8f56b78f231e-kube-api-access-76s66\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:55:03.648045 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.648043 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef856eb5-f851-48ff-ae25-8f56b78f231e-extensions-socket-volume\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:55:03.845051 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.844967 2551 generic.go:356] "Generic (PLEG): container finished" podID="ef856eb5-f851-48ff-ae25-8f56b78f231e" containerID="3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01" exitCode=0 Jun 05 03:55:03.845051 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.845012 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" Jun 05 03:55:03.845244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.845060 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" event={"ID":"ef856eb5-f851-48ff-ae25-8f56b78f231e","Type":"ContainerDied","Data":"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01"} Jun 05 03:55:03.845244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.845136 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm" event={"ID":"ef856eb5-f851-48ff-ae25-8f56b78f231e","Type":"ContainerDied","Data":"6f30b5db36b22d0c69f94cf7cc48bf2e9ceb88aa914ba927b42b6c77495486eb"} Jun 05 03:55:03.845244 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.845162 2551 scope.go:117] "RemoveContainer" containerID="3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01" Jun 05 03:55:03.853563 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.853542 2551 scope.go:117] "RemoveContainer" containerID="3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01" Jun 05 03:55:03.853806 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:55:03.853789 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01\": container with ID starting with 3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01 not found: ID does not exist" containerID="3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01" Jun 05 03:55:03.853874 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.853817 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01"} err="failed to get container status \"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01\": rpc error: code = NotFound desc = could not find container \"3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01\": container with ID starting with 3cb9db72432b3b6eaf196c1a5066f0903d2e5923870b001528be27978816ae01 not found: ID does not exist" Jun 05 03:55:03.869026 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.869003 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:55:03.873013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:03.872986 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zwm"] Jun 05 03:55:05.207285 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:05.207254 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef856eb5-f851-48ff-ae25-8f56b78f231e" path="/var/lib/kubelet/pods/ef856eb5-f851-48ff-ae25-8f56b78f231e/volumes" Jun 05 03:55:19.510704 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.510661 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44"] Jun 05 03:55:19.511171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.510961 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef856eb5-f851-48ff-ae25-8f56b78f231e" containerName="manager" Jun 05 03:55:19.511171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.510971 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef856eb5-f851-48ff-ae25-8f56b78f231e" containerName="manager" Jun 05 03:55:19.511171 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.511029 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef856eb5-f851-48ff-ae25-8f56b78f231e" containerName="manager" Jun 05 03:55:19.517991 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.517963 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.524245 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.524196 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2j6s4\"" Jun 05 03:55:19.528237 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.528206 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44"] Jun 05 03:55:19.578215 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578178 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578380 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578271 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22a29739-0edd-49c0-8327-e07efb541514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578380 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578316 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578380 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578344 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578485 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578437 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22a29739-0edd-49c0-8327-e07efb541514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578518 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578483 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578551 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578531 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578585 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578572 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prn82\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-kube-api-access-prn82\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.578618 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.578604 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.679834 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679794 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679850 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22a29739-0edd-49c0-8327-e07efb541514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679874 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679897 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679937 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22a29739-0edd-49c0-8327-e07efb541514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679958 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.679978 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680013 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prn82\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-kube-api-access-prn82\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680052 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680042 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680391 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680436 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680451 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680590 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680530 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.680918 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.680897 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22a29739-0edd-49c0-8327-e07efb541514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.682419 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.682393 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22a29739-0edd-49c0-8327-e07efb541514-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.682654 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.682635 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22a29739-0edd-49c0-8327-e07efb541514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.689248 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.689178 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.689248 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.689196 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prn82\" (UniqueName: \"kubernetes.io/projected/22a29739-0edd-49c0-8327-e07efb541514-kube-api-access-prn82\") pod \"maas-default-gateway-openshift-default-687ff6996-ggq44\" (UID: \"22a29739-0edd-49c0-8327-e07efb541514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.836631 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.836537 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:19.972447 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:19.972422 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44"] Jun 05 03:55:19.975025 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:55:19.974998 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a29739_0edd_49c0_8327_e07efb541514.slice/crio-1f043ac8d34b8ef4b7270040b7dacc83228ba43b369cd67235361e79317636cb WatchSource:0}: Error finding container 1f043ac8d34b8ef4b7270040b7dacc83228ba43b369cd67235361e79317636cb: Status 404 returned error can't find the container with id 1f043ac8d34b8ef4b7270040b7dacc83228ba43b369cd67235361e79317636cb Jun 05 03:55:20.922560 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:20.922529 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" event={"ID":"22a29739-0edd-49c0-8327-e07efb541514","Type":"ContainerStarted","Data":"1f043ac8d34b8ef4b7270040b7dacc83228ba43b369cd67235361e79317636cb"} Jun 05 03:55:23.584735 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:23.584704 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:55:23.584969 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:23.584774 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:55:23.584969 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:23.584805 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:55:23.937438 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:23.937348 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" event={"ID":"22a29739-0edd-49c0-8327-e07efb541514","Type":"ContainerStarted","Data":"2794d1546102eb6c07b71e3f93cbeb075e0573de4a6746cbe8a7641339a650de"} Jun 05 03:55:23.956919 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:23.956865 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" podStartSLOduration=1.3494079399999999 podStartE2EDuration="4.956850098s" totalImagesPullingTime="3.607442158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:23.954982885 +0000 UTC m=+739.230355954" watchObservedRunningTime="2026-06-05 03:55:23.956850098 +0000 UTC m=+739.232223167" Jun 05 03:55:24.837437 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:24.837395 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:24.842284 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:24.842260 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:24.941936 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:24.941907 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:24.942899 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:24.942878 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:55:34.565058 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.565023 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:55:34.568201 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.568179 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.570757 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.570741 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s4spl\"" Jun 05 03:55:34.570815 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.570740 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 03:55:34.575245 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.574820 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:55:34.604975 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.604939 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:55:34.712542 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.712504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faee83ce-40bd-43ab-828f-683df2a26b7f-config-file\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.712717 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.712547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6gh\" (UniqueName: \"kubernetes.io/projected/faee83ce-40bd-43ab-828f-683df2a26b7f-kube-api-access-mp6gh\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.813884 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.813842 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faee83ce-40bd-43ab-828f-683df2a26b7f-config-file\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.814053 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.813892 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6gh\" (UniqueName: \"kubernetes.io/projected/faee83ce-40bd-43ab-828f-683df2a26b7f-kube-api-access-mp6gh\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.814533 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.814512 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faee83ce-40bd-43ab-828f-683df2a26b7f-config-file\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.823905 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.823847 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6gh\" (UniqueName: \"kubernetes.io/projected/faee83ce-40bd-43ab-828f-683df2a26b7f-kube-api-access-mp6gh\") pod \"limitador-limitador-54d6d988d5-hslmf\" (UID: \"faee83ce-40bd-43ab-828f-683df2a26b7f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:34.879605 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:34.879553 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:35.009850 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:35.009813 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:55:35.013171 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:55:35.013140 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaee83ce_40bd_43ab_828f_683df2a26b7f.slice/crio-0f2641559128346501a1d74c00644ac8c9da6603399d6fa1e47b3c401d54466c WatchSource:0}: Error finding container 0f2641559128346501a1d74c00644ac8c9da6603399d6fa1e47b3c401d54466c: Status 404 returned error can't find the container with id 0f2641559128346501a1d74c00644ac8c9da6603399d6fa1e47b3c401d54466c Jun 05 03:55:35.990761 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:35.990720 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" event={"ID":"faee83ce-40bd-43ab-828f-683df2a26b7f","Type":"ContainerStarted","Data":"0f2641559128346501a1d74c00644ac8c9da6603399d6fa1e47b3c401d54466c"} Jun 05 03:55:38.000422 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:38.000387 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" event={"ID":"faee83ce-40bd-43ab-828f-683df2a26b7f","Type":"ContainerStarted","Data":"b27ee4b52bd2cc526a4a9d57e6dccc04bfe6eb9b422e0f295157a1bf03e3beb8"} Jun 05 03:55:38.000810 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:38.000498 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:55:38.020630 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:38.020580 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" podStartSLOduration=1.660994435 podStartE2EDuration="4.020564571s" totalImagesPullingTime="2.359570136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:38.018602588 +0000 UTC m=+753.293975660" watchObservedRunningTime="2026-06-05 03:55:38.020564571 +0000 UTC m=+753.295937641" Jun 05 03:55:49.005535 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:55:49.005505 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hslmf" Jun 05 03:57:05.215928 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.215897 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:05.218979 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.218961 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:05.221943 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.221924 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z6ckl\"" Jun 05 03:57:05.237822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.237793 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 03:57:05.239592 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.239566 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:05.342575 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.342538 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzcl\" (UniqueName: \"kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl\") pod \"maas-controller-85c778478-hrtzz\" (UID: \"382c425e-0fb7-4bd0-81d1-260935b758e0\") " pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:05.397497 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.397468 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 03:57:05.400967 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.400941 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:05.408922 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.408891 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 03:57:05.443005 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.442970 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdsvp\" (UniqueName: \"kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp\") pod \"maas-controller-75d79b54cb-s9c65\" (UID: \"83644713-63a1-4ef4-84c9-5ff79262835c\") " pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:05.443211 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.443015 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzcl\" (UniqueName: \"kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl\") pod \"maas-controller-85c778478-hrtzz\" (UID: \"382c425e-0fb7-4bd0-81d1-260935b758e0\") " pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:05.451029 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.451007 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzcl\" (UniqueName: \"kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl\") pod \"maas-controller-85c778478-hrtzz\" (UID: \"382c425e-0fb7-4bd0-81d1-260935b758e0\") " pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:05.529209 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.529172 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:05.544560 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.544523 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdsvp\" (UniqueName: \"kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp\") pod \"maas-controller-75d79b54cb-s9c65\" (UID: \"83644713-63a1-4ef4-84c9-5ff79262835c\") " pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:05.552770 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.552739 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdsvp\" (UniqueName: \"kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp\") pod \"maas-controller-75d79b54cb-s9c65\" (UID: \"83644713-63a1-4ef4-84c9-5ff79262835c\") " pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:05.657021 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.656858 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:05.659347 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:57:05.659321 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382c425e_0fb7_4bd0_81d1_260935b758e0.slice/crio-e21171d55ed1ac2ed9f84abf0f2ad2bccbe72e7b86b71d31817cc3411202ffe5 WatchSource:0}: Error finding container e21171d55ed1ac2ed9f84abf0f2ad2bccbe72e7b86b71d31817cc3411202ffe5: Status 404 returned error can't find the container with id e21171d55ed1ac2ed9f84abf0f2ad2bccbe72e7b86b71d31817cc3411202ffe5 Jun 05 03:57:05.711319 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.711275 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:05.836789 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:05.836752 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 03:57:05.839666 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:57:05.839640 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83644713_63a1_4ef4_84c9_5ff79262835c.slice/crio-9734f4e45eebce89f1a40d3e51bcc4ac48df9e2acde1c49fb2c63b7f9bf97b5c WatchSource:0}: Error finding container 9734f4e45eebce89f1a40d3e51bcc4ac48df9e2acde1c49fb2c63b7f9bf97b5c: Status 404 returned error can't find the container with id 9734f4e45eebce89f1a40d3e51bcc4ac48df9e2acde1c49fb2c63b7f9bf97b5c Jun 05 03:57:06.395148 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:06.395045 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c778478-hrtzz" event={"ID":"382c425e-0fb7-4bd0-81d1-260935b758e0","Type":"ContainerStarted","Data":"e21171d55ed1ac2ed9f84abf0f2ad2bccbe72e7b86b71d31817cc3411202ffe5"} Jun 05 03:57:06.398213 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:06.398095 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-s9c65" event={"ID":"83644713-63a1-4ef4-84c9-5ff79262835c","Type":"ContainerStarted","Data":"9734f4e45eebce89f1a40d3e51bcc4ac48df9e2acde1c49fb2c63b7f9bf97b5c"} Jun 05 03:57:09.415289 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.415256 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c778478-hrtzz" event={"ID":"382c425e-0fb7-4bd0-81d1-260935b758e0","Type":"ContainerStarted","Data":"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f"} Jun 05 03:57:09.415741 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.415368 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:09.416727 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.416697 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-s9c65" event={"ID":"83644713-63a1-4ef4-84c9-5ff79262835c","Type":"ContainerStarted","Data":"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde"} Jun 05 03:57:09.416847 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.416742 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:09.431540 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.431489 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c778478-hrtzz" podStartSLOduration=1.734748019 podStartE2EDuration="4.431471433s" totalImagesPullingTime="2.696723414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:09.430404984 +0000 UTC m=+844.705778064" watchObservedRunningTime="2026-06-05 03:57:09.431471433 +0000 UTC m=+844.706844515" Jun 05 03:57:09.445499 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:09.445444 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75d79b54cb-s9c65" podStartSLOduration=1.918125209 podStartE2EDuration="4.445425926s" totalImagesPullingTime="2.527300717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:09.444862153 +0000 UTC m=+844.720235224" watchObservedRunningTime="2026-06-05 03:57:09.445425926 +0000 UTC m=+844.720798996" Jun 05 03:57:20.427544 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.427513 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:20.427900 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.427665 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 03:57:20.480807 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.480775 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:20.480998 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.480974 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85c778478-hrtzz" podUID="382c425e-0fb7-4bd0-81d1-260935b758e0" containerName="manager" containerID="cri-o://782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f" gracePeriod=30 Jun 05 03:57:20.721991 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.721969 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:20.769412 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.769376 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgzcl\" (UniqueName: \"kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl\") pod \"382c425e-0fb7-4bd0-81d1-260935b758e0\" (UID: \"382c425e-0fb7-4bd0-81d1-260935b758e0\") " Jun 05 03:57:20.771507 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.771469 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl" (OuterVolumeSpecName: "kube-api-access-wgzcl") pod "382c425e-0fb7-4bd0-81d1-260935b758e0" (UID: "382c425e-0fb7-4bd0-81d1-260935b758e0"). InnerVolumeSpecName "kube-api-access-wgzcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:57:20.870240 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:20.870207 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgzcl\" (UniqueName: \"kubernetes.io/projected/382c425e-0fb7-4bd0-81d1-260935b758e0-kube-api-access-wgzcl\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 03:57:21.472781 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.472695 2551 generic.go:356] "Generic (PLEG): container finished" podID="382c425e-0fb7-4bd0-81d1-260935b758e0" containerID="782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f" exitCode=0 Jun 05 03:57:21.472781 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.472738 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c778478-hrtzz" Jun 05 03:57:21.473212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.472787 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c778478-hrtzz" event={"ID":"382c425e-0fb7-4bd0-81d1-260935b758e0","Type":"ContainerDied","Data":"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f"} Jun 05 03:57:21.473212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.472836 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c778478-hrtzz" event={"ID":"382c425e-0fb7-4bd0-81d1-260935b758e0","Type":"ContainerDied","Data":"e21171d55ed1ac2ed9f84abf0f2ad2bccbe72e7b86b71d31817cc3411202ffe5"} Jun 05 03:57:21.473212 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.472858 2551 scope.go:117] "RemoveContainer" containerID="782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f" Jun 05 03:57:21.480790 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.480772 2551 scope.go:117] "RemoveContainer" containerID="782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f" Jun 05 03:57:21.481027 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:57:21.481011 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f\": container with ID starting with 782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f not found: ID does not exist" containerID="782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f" Jun 05 03:57:21.481076 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.481036 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f"} err="failed to get container status \"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f\": rpc error: code = NotFound desc = could not find container \"782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f\": container with ID starting with 782e9d61b481567ccec19748c6de08ff8cb652625613df22c98fa4071d80fc3f not found: ID does not exist" Jun 05 03:57:21.488350 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.488327 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:21.491350 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:21.491329 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c778478-hrtzz"] Jun 05 03:57:23.208142 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:23.208086 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382c425e-0fb7-4bd0-81d1-260935b758e0" path="/var/lib/kubelet/pods/382c425e-0fb7-4bd0-81d1-260935b758e0/volumes" Jun 05 03:57:37.080124 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.080071 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7cc46cc648-bbdmv"] Jun 05 03:57:37.080592 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.080428 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382c425e-0fb7-4bd0-81d1-260935b758e0" containerName="manager" Jun 05 03:57:37.080592 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.080440 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c425e-0fb7-4bd0-81d1-260935b758e0" containerName="manager" Jun 05 03:57:37.080592 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.080495 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="382c425e-0fb7-4bd0-81d1-260935b758e0" containerName="manager" Jun 05 03:57:37.083470 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.083451 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.086795 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.086773 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2ttzx\"" Jun 05 03:57:37.086908 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.086864 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 05 03:57:37.101936 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.101911 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cc46cc648-bbdmv"] Jun 05 03:57:37.207236 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.207198 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcl8m\" (UniqueName: \"kubernetes.io/projected/4e237e51-7bbe-4866-9d5c-4d2ada721d18-kube-api-access-zcl8m\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.207236 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.207240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.308070 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.308030 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.308284 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.308171 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcl8m\" (UniqueName: \"kubernetes.io/projected/4e237e51-7bbe-4866-9d5c-4d2ada721d18-kube-api-access-zcl8m\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.308284 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:57:37.308246 2551 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 03:57:37.308419 ip-10-0-139-39 kubenswrapper[2551]: E0605 03:57:37.308334 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls podName:4e237e51-7bbe-4866-9d5c-4d2ada721d18 nodeName:}" failed. No retries permitted until 2026-06-05 03:57:37.808310825 +0000 UTC m=+873.083683878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls") pod "maas-api-7cc46cc648-bbdmv" (UID: "4e237e51-7bbe-4866-9d5c-4d2ada721d18") : secret "maas-api-serving-cert" not found Jun 05 03:57:37.317177 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.317153 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcl8m\" (UniqueName: \"kubernetes.io/projected/4e237e51-7bbe-4866-9d5c-4d2ada721d18-kube-api-access-zcl8m\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.562030 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.562001 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jnz2v"] Jun 05 03:57:37.565390 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.565371 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:37.567892 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.567869 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 03:57:37.568013 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.567931 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r6m99\"" Jun 05 03:57:37.573474 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.573452 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jnz2v"] Jun 05 03:57:37.611805 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.611764 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:57:37.712443 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.712409 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58m7z\" (UniqueName: \"kubernetes.io/projected/5122fb8b-4162-4124-968f-8a6da0fedbcd-kube-api-access-58m7z\") pod \"payload-processing-7c6c859784-jnz2v\" (UID: \"5122fb8b-4162-4124-968f-8a6da0fedbcd\") " pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:37.813930 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.813846 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58m7z\" (UniqueName: \"kubernetes.io/projected/5122fb8b-4162-4124-968f-8a6da0fedbcd-kube-api-access-58m7z\") pod \"payload-processing-7c6c859784-jnz2v\" (UID: \"5122fb8b-4162-4124-968f-8a6da0fedbcd\") " pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:37.813930 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.813914 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.816342 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.816312 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e237e51-7bbe-4866-9d5c-4d2ada721d18-maas-api-tls\") pod \"maas-api-7cc46cc648-bbdmv\" (UID: \"4e237e51-7bbe-4866-9d5c-4d2ada721d18\") " pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:37.821240 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.821216 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58m7z\" (UniqueName: \"kubernetes.io/projected/5122fb8b-4162-4124-968f-8a6da0fedbcd-kube-api-access-58m7z\") pod \"payload-processing-7c6c859784-jnz2v\" (UID: \"5122fb8b-4162-4124-968f-8a6da0fedbcd\") " pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:37.876153 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.876095 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:37.994547 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:37.994516 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:38.007186 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:38.007156 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jnz2v"] Jun 05 03:57:38.008932 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:57:38.008896 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5122fb8b_4162_4124_968f_8a6da0fedbcd.slice/crio-86b0fa89c015ee36d814d58f56e6715001e62517075d6898d89d7e07c1437136 WatchSource:0}: Error finding container 86b0fa89c015ee36d814d58f56e6715001e62517075d6898d89d7e07c1437136: Status 404 returned error can't find the container with id 86b0fa89c015ee36d814d58f56e6715001e62517075d6898d89d7e07c1437136 Jun 05 03:57:38.127040 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:38.127007 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cc46cc648-bbdmv"] Jun 05 03:57:38.130749 ip-10-0-139-39 kubenswrapper[2551]: W0605 03:57:38.130724 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e237e51_7bbe_4866_9d5c_4d2ada721d18.slice/crio-205eb8e2887c2b30f9b6b3d95478d6ab78868e661039897697c4e9ff19f1ad48 WatchSource:0}: Error finding container 205eb8e2887c2b30f9b6b3d95478d6ab78868e661039897697c4e9ff19f1ad48: Status 404 returned error can't find the container with id 205eb8e2887c2b30f9b6b3d95478d6ab78868e661039897697c4e9ff19f1ad48 Jun 05 03:57:38.560098 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:38.560055 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cc46cc648-bbdmv" event={"ID":"4e237e51-7bbe-4866-9d5c-4d2ada721d18","Type":"ContainerStarted","Data":"205eb8e2887c2b30f9b6b3d95478d6ab78868e661039897697c4e9ff19f1ad48"} Jun 05 03:57:38.561632 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:38.561592 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" event={"ID":"5122fb8b-4162-4124-968f-8a6da0fedbcd","Type":"ContainerStarted","Data":"86b0fa89c015ee36d814d58f56e6715001e62517075d6898d89d7e07c1437136"} Jun 05 03:57:41.581663 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.581621 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cc46cc648-bbdmv" event={"ID":"4e237e51-7bbe-4866-9d5c-4d2ada721d18","Type":"ContainerStarted","Data":"0e83e9ffff04e03dccf2119d7b399e3d84deccc4a698c7a6c5eda16548c2f1a3"} Jun 05 03:57:41.582188 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.581693 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:41.583214 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.583191 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" event={"ID":"5122fb8b-4162-4124-968f-8a6da0fedbcd","Type":"ContainerStarted","Data":"4d32f5b0d426097937a035524f49ccf7364c6cf3807fff8fb84b2638e731ffd2"} Jun 05 03:57:41.583333 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.583310 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:57:41.598092 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.598048 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7cc46cc648-bbdmv" podStartSLOduration=1.552478305 podStartE2EDuration="4.598033387s" totalImagesPullingTime="3.045555082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:41.596522871 +0000 UTC m=+876.871895942" watchObservedRunningTime="2026-06-05 03:57:41.598033387 +0000 UTC m=+876.873406456" Jun 05 03:57:41.614378 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:41.614333 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" podStartSLOduration=1.396037515 podStartE2EDuration="4.614316208s" totalImagesPullingTime="3.218278693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:41.613081127 +0000 UTC m=+876.888454198" watchObservedRunningTime="2026-06-05 03:57:41.614316208 +0000 UTC m=+876.889689278" Jun 05 03:57:45.603194 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.603157 2551 generic.go:356] "Generic (PLEG): container finished" podID="22a29739-0edd-49c0-8327-e07efb541514" containerID="2794d1546102eb6c07b71e3f93cbeb075e0573de4a6746cbe8a7641339a650de" exitCode=0 Jun 05 03:57:45.603723 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.603232 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" event={"ID":"22a29739-0edd-49c0-8327-e07efb541514","Type":"ContainerDied","Data":"2794d1546102eb6c07b71e3f93cbeb075e0573de4a6746cbe8a7641339a650de"} Jun 05 03:57:45.603814 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.603729 2551 scope.go:117] "RemoveContainer" containerID="2794d1546102eb6c07b71e3f93cbeb075e0573de4a6746cbe8a7641339a650de" Jun 05 03:57:45.604702 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.604672 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:57:45.604817 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.604755 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:57:45.604817 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:45.604804 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 03:57:46.609822 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:46.609779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" event={"ID":"22a29739-0edd-49c0-8327-e07efb541514","Type":"ContainerStarted","Data":"0491330442d060ffdd07bffb215e03b77d1689f6675c35f0658dd931b03e402e"} Jun 05 03:57:46.837579 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:46.837544 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:57:46.837859 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:46.837600 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ggq44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jun 05 03:57:46.838035 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:46.838009 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" podUID="22a29739-0edd-49c0-8327-e07efb541514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jun 05 03:57:47.592667 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:47.592636 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7cc46cc648-bbdmv" Jun 05 03:57:47.849794 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:47.849687 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ggq44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jun 05 03:57:47.849794 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:47.849779 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" podUID="22a29739-0edd-49c0-8327-e07efb541514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jun 05 03:57:48.837812 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:48.837762 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ggq44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jun 05 03:57:48.838011 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:48.837842 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" podUID="22a29739-0edd-49c0-8327-e07efb541514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jun 05 03:57:49.837410 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:49.837369 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ggq44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jun 05 03:57:49.837907 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:49.837480 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" podUID="22a29739-0edd-49c0-8327-e07efb541514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jun 05 03:57:50.841617 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:50.841585 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:57:50.842089 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:50.841959 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:57:50.842618 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:50.842599 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ggq44" Jun 05 03:57:52.590265 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:57:52.590233 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jnz2v" Jun 05 03:58:35.345935 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:58:35.345896 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:58:44.244226 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:58:44.244185 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:58:55.848814 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:58:55.848779 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:59:14.442299 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:59:14.442252 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 03:59:19.342288 ip-10-0-139-39 kubenswrapper[2551]: I0605 03:59:19.342255 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:00:06.897528 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.897484 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5"] Jun 05 04:00:06.902412 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.902388 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.905168 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.905144 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 04:00:06.905290 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.905170 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 04:00:06.906208 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.906187 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hc9ks\"" Jun 05 04:00:06.906324 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.906207 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 04:00:06.911296 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.911246 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5"] Jun 05 04:00:06.978781 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978748 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.978972 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978794 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.978972 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978819 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7998b82c-3cdb-4152-9d2e-38adfe29a77d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.978972 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978838 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kube-api-access-zbsxd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.978972 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978863 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:06.978972 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:06.978890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080315 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080274 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080521 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080327 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080521 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080457 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080521 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080516 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080689 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080556 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7998b82c-3cdb-4152-9d2e-38adfe29a77d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080689 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080581 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kube-api-access-zbsxd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080689 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080676 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080834 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080751 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.080834 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.080818 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.082801 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.082773 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7998b82c-3cdb-4152-9d2e-38adfe29a77d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.082968 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.082952 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7998b82c-3cdb-4152-9d2e-38adfe29a77d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.089824 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.089800 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/7998b82c-3cdb-4152-9d2e-38adfe29a77d-kube-api-access-zbsxd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-57pd5\" (UID: \"7998b82c-3cdb-4152-9d2e-38adfe29a77d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.213461 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.213385 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:07.356976 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.356949 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5"] Jun 05 04:00:07.359607 ip-10-0-139-39 kubenswrapper[2551]: W0605 04:00:07.359579 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7998b82c_3cdb_4152_9d2e_38adfe29a77d.slice/crio-6776083651bd8ddcd1e6bb19a0c5be451e1d6929ae4bf4bf47247101ad1d8178 WatchSource:0}: Error finding container 6776083651bd8ddcd1e6bb19a0c5be451e1d6929ae4bf4bf47247101ad1d8178: Status 404 returned error can't find the container with id 6776083651bd8ddcd1e6bb19a0c5be451e1d6929ae4bf4bf47247101ad1d8178 Jun 05 04:00:07.361464 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:07.361447 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 04:00:08.257669 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:08.257631 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" event={"ID":"7998b82c-3cdb-4152-9d2e-38adfe29a77d","Type":"ContainerStarted","Data":"6776083651bd8ddcd1e6bb19a0c5be451e1d6929ae4bf4bf47247101ad1d8178"} Jun 05 04:00:08.847889 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:08.847851 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:00:11.272701 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:11.272659 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" event={"ID":"7998b82c-3cdb-4152-9d2e-38adfe29a77d","Type":"ContainerStarted","Data":"899ec73c4a92ce8d5562b96c566ff9e8c9fd73a430e1064c2c7708de3016cd97"} Jun 05 04:00:13.283633 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:13.283599 2551 generic.go:356] "Generic (PLEG): container finished" podID="7998b82c-3cdb-4152-9d2e-38adfe29a77d" containerID="899ec73c4a92ce8d5562b96c566ff9e8c9fd73a430e1064c2c7708de3016cd97" exitCode=0 Jun 05 04:00:13.284026 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:13.283639 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" event={"ID":"7998b82c-3cdb-4152-9d2e-38adfe29a77d","Type":"ContainerDied","Data":"899ec73c4a92ce8d5562b96c566ff9e8c9fd73a430e1064c2c7708de3016cd97"} Jun 05 04:00:45.435531 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:45.435445 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" event={"ID":"7998b82c-3cdb-4152-9d2e-38adfe29a77d","Type":"ContainerStarted","Data":"4984a7c088a44474f9f95153b801844c340381663b20a09a8af263f1628e7dbf"} Jun 05 04:00:45.453394 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:45.453341 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" podStartSLOduration=2.62753981 podStartE2EDuration="39.453325764s" totalImagesPullingTime="35.528093277s" totalInitContainerRuntime="1.297692677s" isStatefulPod=false podCreationTimestamp="2026-06-05 04:00:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:00:45.45204145 +0000 UTC m=+1060.727414521" watchObservedRunningTime="2026-06-05 04:00:45.453325764 +0000 UTC m=+1060.728698834" Jun 05 04:00:47.214037 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:47.213997 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:47.214037 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:47.214048 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:47.226466 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:47.226442 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:00:47.456342 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:00:47.456314 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-57pd5" Jun 05 04:02:02.950955 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:02.950923 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:13.740636 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:13.740598 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:22.247344 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:22.247305 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:31.241914 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:31.241833 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:41.464052 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:41.464005 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:51.851353 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:51.851309 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:02:57.763703 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:57.763661 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 04:02:57.764185 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:57.763862 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75d79b54cb-s9c65" podUID="83644713-63a1-4ef4-84c9-5ff79262835c" containerName="manager" containerID="cri-o://529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde" gracePeriod=30 Jun 05 04:02:58.026208 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.026145 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 04:02:58.055242 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.055204 2551 generic.go:356] "Generic (PLEG): container finished" podID="83644713-63a1-4ef4-84c9-5ff79262835c" containerID="529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde" exitCode=0 Jun 05 04:02:58.055242 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.055242 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-s9c65" Jun 05 04:02:58.055484 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.055287 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-s9c65" event={"ID":"83644713-63a1-4ef4-84c9-5ff79262835c","Type":"ContainerDied","Data":"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde"} Jun 05 04:02:58.055484 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.055337 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-s9c65" event={"ID":"83644713-63a1-4ef4-84c9-5ff79262835c","Type":"ContainerDied","Data":"9734f4e45eebce89f1a40d3e51bcc4ac48df9e2acde1c49fb2c63b7f9bf97b5c"} Jun 05 04:02:58.055484 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.055361 2551 scope.go:117] "RemoveContainer" containerID="529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde" Jun 05 04:02:58.064061 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.064040 2551 scope.go:117] "RemoveContainer" containerID="529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde" Jun 05 04:02:58.064381 ip-10-0-139-39 kubenswrapper[2551]: E0605 04:02:58.064361 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde\": container with ID starting with 529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde not found: ID does not exist" containerID="529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde" Jun 05 04:02:58.064476 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.064388 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde"} err="failed to get container status \"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde\": rpc error: code = NotFound desc = could not find container \"529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde\": container with ID starting with 529aa1e5779649862657142d32fe99fcdbfe99ae7e311166bdfcdb5079f0bfde not found: ID does not exist" Jun 05 04:02:58.159003 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.158969 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdsvp\" (UniqueName: \"kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp\") pod \"83644713-63a1-4ef4-84c9-5ff79262835c\" (UID: \"83644713-63a1-4ef4-84c9-5ff79262835c\") " Jun 05 04:02:58.161015 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.160982 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp" (OuterVolumeSpecName: "kube-api-access-xdsvp") pod "83644713-63a1-4ef4-84c9-5ff79262835c" (UID: "83644713-63a1-4ef4-84c9-5ff79262835c"). InnerVolumeSpecName "kube-api-access-xdsvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 04:02:58.259923 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.259890 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdsvp\" (UniqueName: \"kubernetes.io/projected/83644713-63a1-4ef4-84c9-5ff79262835c-kube-api-access-xdsvp\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 04:02:58.377196 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.377165 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 04:02:58.380772 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:58.380743 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-s9c65"] Jun 05 04:02:59.139136 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.139081 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75d79b54cb-zbmd8"] Jun 05 04:02:59.139625 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.139605 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83644713-63a1-4ef4-84c9-5ff79262835c" containerName="manager" Jun 05 04:02:59.139702 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.139628 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="83644713-63a1-4ef4-84c9-5ff79262835c" containerName="manager" Jun 05 04:02:59.139760 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.139747 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="83644713-63a1-4ef4-84c9-5ff79262835c" containerName="manager" Jun 05 04:02:59.143826 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.143806 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:02:59.146398 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.146378 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z6ckl\"" Jun 05 04:02:59.146501 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.146410 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 04:02:59.149905 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.149880 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-zbmd8"] Jun 05 04:02:59.210007 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.209971 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83644713-63a1-4ef4-84c9-5ff79262835c" path="/var/lib/kubelet/pods/83644713-63a1-4ef4-84c9-5ff79262835c/volumes" Jun 05 04:02:59.266911 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.266877 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ngm\" (UniqueName: \"kubernetes.io/projected/f84b0843-9a03-4297-8564-49812ab080cd-kube-api-access-j6ngm\") pod \"maas-controller-75d79b54cb-zbmd8\" (UID: \"f84b0843-9a03-4297-8564-49812ab080cd\") " pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:02:59.368087 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.368050 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ngm\" (UniqueName: \"kubernetes.io/projected/f84b0843-9a03-4297-8564-49812ab080cd-kube-api-access-j6ngm\") pod \"maas-controller-75d79b54cb-zbmd8\" (UID: \"f84b0843-9a03-4297-8564-49812ab080cd\") " pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:02:59.376227 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.376201 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ngm\" (UniqueName: \"kubernetes.io/projected/f84b0843-9a03-4297-8564-49812ab080cd-kube-api-access-j6ngm\") pod \"maas-controller-75d79b54cb-zbmd8\" (UID: \"f84b0843-9a03-4297-8564-49812ab080cd\") " pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:02:59.456351 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.456252 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:02:59.584717 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:02:59.584691 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d79b54cb-zbmd8"] Jun 05 04:02:59.587403 ip-10-0-139-39 kubenswrapper[2551]: W0605 04:02:59.587374 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84b0843_9a03_4297_8564_49812ab080cd.slice/crio-0fd6455dfbe9bc28efc42876654e8c182f946d17b8e262930bee68649eb9c9c4 WatchSource:0}: Error finding container 0fd6455dfbe9bc28efc42876654e8c182f946d17b8e262930bee68649eb9c9c4: Status 404 returned error can't find the container with id 0fd6455dfbe9bc28efc42876654e8c182f946d17b8e262930bee68649eb9c9c4 Jun 05 04:03:00.071334 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:00.071298 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" event={"ID":"f84b0843-9a03-4297-8564-49812ab080cd","Type":"ContainerStarted","Data":"69553f18cb94c70017398212cd890629b84fdeb3f1a75a6be1eda3c36bd443e9"} Jun 05 04:03:00.071509 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:00.071352 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" event={"ID":"f84b0843-9a03-4297-8564-49812ab080cd","Type":"ContainerStarted","Data":"0fd6455dfbe9bc28efc42876654e8c182f946d17b8e262930bee68649eb9c9c4"} Jun 05 04:03:00.071509 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:00.071418 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:03:00.090664 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:00.090614 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" podStartSLOduration=0.707936835 podStartE2EDuration="1.090597s" totalImagesPullingTime="382.660165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 04:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:03:00.088746506 +0000 UTC m=+1195.364119579" watchObservedRunningTime="2026-06-05 04:03:00.090597 +0000 UTC m=+1195.365970069" Jun 05 04:03:11.082705 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:11.082666 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75d79b54cb-zbmd8" Jun 05 04:03:22.342040 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:22.342005 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:03:31.143170 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:03:31.143079 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:04:04.753775 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:04:04.753740 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:04:20.757362 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:04:20.757329 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:05:00.140678 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:05:00.140643 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:05:16.242906 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:05:16.242871 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:05:31.049351 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:05:31.049275 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:05:46.046397 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:05:46.046360 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:06:43.236757 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:06:43.236718 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:06:52.453396 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:06:52.453361 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:07:08.045447 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:07:08.045409 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:07:17.438227 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:07:17.438184 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:07:34.540045 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:07:34.539995 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:07:43.244119 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:07:43.244070 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:08:14.838062 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:08:14.838029 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:08:23.145157 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:08:23.145087 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:08:33.033564 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:08:33.033484 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:08:41.147178 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:08:41.147146 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:08:48.245363 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:08:48.245317 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:09:05.745435 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:09:05.745397 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:09:17.053608 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:09:17.053573 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:03.647151 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:03.647099 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:09.739024 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:09.738979 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:18.342128 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:18.342068 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:26.843932 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:26.843897 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:35.635258 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:35.635225 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:42.751340 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:42.751307 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:10:53.442613 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:10:53.442570 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:01.948295 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:01.948262 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:10.852330 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:10.852294 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:19.442175 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:19.442139 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:28.740901 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:28.740823 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:35.850284 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:35.850250 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:46.641602 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:46.641563 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:11:53.445530 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:11:53.445494 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:12:02.037861 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:12:02.037820 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:12:12.148931 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:12:12.148897 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:12:21.040740 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:12:21.040705 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:12:27.843141 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:12:27.843090 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:14:45.545280 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:14:45.545197 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:14:52.047733 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:14:52.047701 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:15:17.047088 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:15:17.047054 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:15:23.043389 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:15:23.043352 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:15:33.446954 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:15:33.446919 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:15:43.043895 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:15:43.043859 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:15:52.846344 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:15:52.846303 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:03.847573 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:03.847535 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:13.039787 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:13.039747 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:22.042408 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:22.042375 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:31.319101 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:31.319064 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:40.948494 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:40.948456 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:16:51.544489 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:16:51.544453 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:17:24.844612 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:17:24.844526 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:08.045793 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:08.045745 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:17.250096 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:17.250061 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:26.442365 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:26.442332 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:36.444278 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:36.444239 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:42.541801 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:42.541768 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:18:56.944798 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:18:56.944709 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:05.645564 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:05.645528 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:13.740697 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:13.740659 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:24.138055 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:24.138020 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:32.849563 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:32.849526 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:41.938955 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:41.938918 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:19:54.101765 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:19:54.101729 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:20:10.940269 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:20:10.940234 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:20:19.837191 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:20:19.837154 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:20:28.149889 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:20:28.149806 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:20:37.734455 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:20:37.734413 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:20:53.745149 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:20:53.745093 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:02.747177 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:02.747141 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:11.444284 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:11.444247 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:18.152042 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:18.152006 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:29.046867 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:29.046830 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:35.564125 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:35.564071 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:45.944527 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:45.944489 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:21:59.449643 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:21:59.449551 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:08.046553 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:08.046513 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:21.440378 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:21.440343 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:30.143148 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:30.143097 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:40.244286 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:40.244248 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:49.048440 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:49.048400 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:22:59.542313 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:22:59.542280 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:23:16.635086 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:23:16.635048 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:23:23.142802 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:23:23.142770 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:23:33.352092 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:23:33.352056 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:23:43.547915 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:23:43.547878 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:24:07.940685 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:07.940651 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:24:20.436675 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:20.436636 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hslmf"] Jun 05 04:24:31.125905 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.125875 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccfd96f5-p2wvv_8c070297-19ce-4e02-a327-dbc171506ab4/nginx/0.log" Jun 05 04:24:31.245663 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.245635 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mbvkm_8e6c8aab-bc0b-4135-967b-b65109eaaa43/manager/0.log" Jun 05 04:24:31.361891 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.361865 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cf2p8_65806521-1be0-4d25-b6b3-93361d47385b/manager/0.log" Jun 05 04:24:31.475762 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.475696 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cc46cc648-bbdmv_4e237e51-7bbe-4866-9d5c-4d2ada721d18/maas-api/0.log" Jun 05 04:24:31.832150 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.832126 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75d79b54cb-zbmd8_f84b0843-9a03-4297-8564-49812ab080cd/manager/0.log" Jun 05 04:24:31.949271 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:31.949247 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-k62pg_3ec9978c-ecfe-40cd-ab19-8049854d66a9/server/0.log" Jun 05 04:24:32.073974 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:32.073948 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ldpvn_44a97407-59ae-4a62-b2d4-383fd78547f6/manager/0.log" Jun 05 04:24:32.437552 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:32.437526 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-lzdct_65790009-021a-47eb-a72f-3a8a6f8acd57/copy-manifests/0.log" Jun 05 04:24:32.449267 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:32.449241 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-lzdct_65790009-021a-47eb-a72f-3a8a6f8acd57/manager/0.log" Jun 05 04:24:34.111242 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:34.111209 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x4qtl_cf6338d6-362f-4a1e-98d7-230f74eec7ba/manager/0.log" Jun 05 04:24:34.572531 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:34.572507 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hslmf_faee83ce-40bd-43ab-828f-683df2a26b7f/limitador/0.log" Jun 05 04:24:35.165179 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:35.165154 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xd7q_ee60dd12-ba19-4451-a6c1-3029586a3c01/discovery/0.log" Jun 05 04:24:35.272653 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:35.272622 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddd7d4874-llmgm_9ef10785-ac21-426b-b187-fa0a3ac4bdc9/kube-auth-proxy/0.log" Jun 05 04:24:35.513119 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:35.513091 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/1.log" Jun 05 04:24:35.745648 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:35.745621 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jnz2v_5122fb8b-4162-4124-968f-8a6da0fedbcd/payload-processing/0.log" Jun 05 04:24:36.819086 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:36.819052 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-57pd5_7998b82c-3cdb-4152-9d2e-38adfe29a77d/storage-initializer/0.log" Jun 05 04:24:36.827523 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:36.827498 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-57pd5_7998b82c-3cdb-4152-9d2e-38adfe29a77d/main/0.log" Jun 05 04:24:44.158045 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:44.158015 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-98g5d_ea9abade-2a74-44f3-8341-ab4b830c5ce4/global-pull-secret-syncer/0.log" Jun 05 04:24:44.344967 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:44.344934 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xn2vb_e9fdc225-aea5-45e8-99d8-7059582f3c70/konnectivity-agent/0.log" Jun 05 04:24:44.386856 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:44.386826 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-39.ec2.internal_cd7eb7d4f442858d5fa850411397de67/haproxy/0.log" Jun 05 04:24:48.134475 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:48.134446 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-sgw7f_5130970b-c899-4c19-8390-183cdb884de4/sail-operator/0.log" Jun 05 04:24:49.753124 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:49.753091 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x4qtl_cf6338d6-362f-4a1e-98d7-230f74eec7ba/manager/0.log" Jun 05 04:24:49.897878 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:49.897848 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hslmf_faee83ce-40bd-43ab-828f-683df2a26b7f/limitador/0.log" Jun 05 04:24:51.979163 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:51.979132 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rvhsb_7a37e7b7-5805-421a-b07c-cb6f665f5ae0/node-exporter/0.log" Jun 05 04:24:51.998880 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:51.998856 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rvhsb_7a37e7b7-5805-421a-b07c-cb6f665f5ae0/kube-rbac-proxy/0.log" Jun 05 04:24:52.023070 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:52.023038 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rvhsb_7a37e7b7-5805-421a-b07c-cb6f665f5ae0/init-textfile/0.log" Jun 05 04:24:56.938863 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.938787 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h"] Jun 05 04:24:56.941996 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.941979 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:56.944538 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.944513 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2zf9s\"/\"openshift-service-ca.crt\"" Jun 05 04:24:56.944645 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.944555 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2zf9s\"/\"kube-root-ca.crt\"" Jun 05 04:24:56.945781 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.945763 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2zf9s\"/\"default-dockercfg-gdlcz\"" Jun 05 04:24:56.953129 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:56.953094 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h"] Jun 05 04:24:57.076447 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.076408 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-sys\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.076447 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.076452 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brnnl\" (UniqueName: \"kubernetes.io/projected/2b559f31-ba1b-47a1-a564-ba1aef99a617-kube-api-access-brnnl\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.076665 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.076475 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-lib-modules\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.076665 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.076496 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-podres\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.076665 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.076590 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-proc\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.177906 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.177870 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-proc\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178091 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.177930 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-sys\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178091 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.177955 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brnnl\" (UniqueName: \"kubernetes.io/projected/2b559f31-ba1b-47a1-a564-ba1aef99a617-kube-api-access-brnnl\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178091 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.177975 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-lib-modules\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178091 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.177992 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-podres\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178091 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.178064 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-sys\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178304 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.178070 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-proc\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178304 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.178140 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-podres\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.178304 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.178172 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b559f31-ba1b-47a1-a564-ba1aef99a617-lib-modules\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.185741 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.185718 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brnnl\" (UniqueName: \"kubernetes.io/projected/2b559f31-ba1b-47a1-a564-ba1aef99a617-kube-api-access-brnnl\") pod \"perf-node-gather-daemonset-h7h7h\" (UID: \"2b559f31-ba1b-47a1-a564-ba1aef99a617\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.252482 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.252398 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:57.384327 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.384291 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h"] Jun 05 04:24:57.387046 ip-10-0-139-39 kubenswrapper[2551]: W0605 04:24:57.387019 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b559f31_ba1b_47a1_a564_ba1aef99a617.slice/crio-45a67c0c4074cbc62137a465e4715813c343dc0687ad9bc95efcba0b8127bf55 WatchSource:0}: Error finding container 45a67c0c4074cbc62137a465e4715813c343dc0687ad9bc95efcba0b8127bf55: Status 404 returned error can't find the container with id 45a67c0c4074cbc62137a465e4715813c343dc0687ad9bc95efcba0b8127bf55 Jun 05 04:24:57.429963 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.429942 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnn8d_3f368981-12cc-4126-8dd2-5d91a6ecb2e4/dns/0.log" Jun 05 04:24:57.450134 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.450098 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnn8d_3f368981-12cc-4126-8dd2-5d91a6ecb2e4/kube-rbac-proxy/0.log" Jun 05 04:24:57.474977 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:57.474951 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5dxn_eaec1526-4249-4b5b-84f4-7385a75ab5bb/dns-node-resolver/0.log" Jun 05 04:24:58.116659 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:58.116619 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mbf7r_43e28fdd-56ca-4754-bb13-cad9b1205068/node-ca/0.log" Jun 05 04:24:58.141737 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:58.141710 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" event={"ID":"2b559f31-ba1b-47a1-a564-ba1aef99a617","Type":"ContainerStarted","Data":"1c6200602cff5352cb1e8fb036dc6d14bd45b0b2ea62ece17b3206f399a3c378"} Jun 05 04:24:58.141883 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:58.141754 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" event={"ID":"2b559f31-ba1b-47a1-a564-ba1aef99a617","Type":"ContainerStarted","Data":"45a67c0c4074cbc62137a465e4715813c343dc0687ad9bc95efcba0b8127bf55"} Jun 05 04:24:58.141927 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:58.141896 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:24:58.159446 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:58.159404 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" podStartSLOduration=2.159388793 podStartE2EDuration="2.159388793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 04:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:24:58.157737355 +0000 UTC m=+2513.433110425" watchObservedRunningTime="2026-06-05 04:24:58.159388793 +0000 UTC m=+2513.434761863" Jun 05 04:24:59.173976 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.173948 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xd7q_ee60dd12-ba19-4451-a6c1-3029586a3c01/discovery/0.log" Jun 05 04:24:59.192586 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.192561 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddd7d4874-llmgm_9ef10785-ac21-426b-b187-fa0a3ac4bdc9/kube-auth-proxy/0.log" Jun 05 04:24:59.252647 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.249999 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/0.log" Jun 05 04:24:59.283933 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.283897 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/1.log" Jun 05 04:24:59.389762 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.389719 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jnz2v_5122fb8b-4162-4124-968f-8a6da0fedbcd/payload-processing/0.log" Jun 05 04:24:59.994719 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:24:59.994671 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2g5xb_8029c01e-0113-4f03-b812-661cb58cca37/serve-healthcheck-canary/0.log" Jun 05 04:25:00.600545 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:00.600515 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cljv_ebef173e-14e0-4ae1-bede-1105188dd491/kube-rbac-proxy/0.log" Jun 05 04:25:00.621720 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:00.621694 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cljv_ebef173e-14e0-4ae1-bede-1105188dd491/exporter/0.log" Jun 05 04:25:00.645443 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:00.645417 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cljv_ebef173e-14e0-4ae1-bede-1105188dd491/extractor/0.log" Jun 05 04:25:02.948706 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:02.948680 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccfd96f5-p2wvv_8c070297-19ce-4e02-a327-dbc171506ab4/nginx/0.log" Jun 05 04:25:02.971667 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:02.971613 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mbvkm_8e6c8aab-bc0b-4135-967b-b65109eaaa43/manager/0.log" Jun 05 04:25:03.039014 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.038986 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cf2p8_65806521-1be0-4d25-b6b3-93361d47385b/manager/0.log" Jun 05 04:25:03.074929 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.074900 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cc46cc648-bbdmv_4e237e51-7bbe-4866-9d5c-4d2ada721d18/maas-api/0.log" Jun 05 04:25:03.191567 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.191537 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75d79b54cb-zbmd8_f84b0843-9a03-4297-8564-49812ab080cd/manager/0.log" Jun 05 04:25:03.212616 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.212529 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-k62pg_3ec9978c-ecfe-40cd-ab19-8049854d66a9/server/0.log" Jun 05 04:25:03.258675 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.258647 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ldpvn_44a97407-59ae-4a62-b2d4-383fd78547f6/manager/0.log" Jun 05 04:25:03.460790 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.460757 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-lzdct_65790009-021a-47eb-a72f-3a8a6f8acd57/manager/0.log" Jun 05 04:25:03.477962 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:03.477887 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-lzdct_65790009-021a-47eb-a72f-3a8a6f8acd57/copy-manifests/0.log" Jun 05 04:25:04.156536 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:04.156511 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-h7h7h" Jun 05 04:25:05.034623 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:05.034583 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8vgw9_e68d02ac-2c7c-4795-a4b5-2726ee185824/openshift-lws-operator/0.log" Jun 05 04:25:09.700578 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:09.700547 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xd7q_ee60dd12-ba19-4451-a6c1-3029586a3c01/discovery/0.log" Jun 05 04:25:09.710908 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:09.710887 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddd7d4874-llmgm_9ef10785-ac21-426b-b187-fa0a3ac4bdc9/kube-auth-proxy/0.log" Jun 05 04:25:09.747361 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:09.747337 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/0.log" Jun 05 04:25:09.776859 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:09.776836 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/1.log" Jun 05 04:25:09.870186 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:09.870158 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jnz2v_5122fb8b-4162-4124-968f-8a6da0fedbcd/payload-processing/0.log" Jun 05 04:25:11.132792 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:11.132761 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xd7q_ee60dd12-ba19-4451-a6c1-3029586a3c01/discovery/0.log" Jun 05 04:25:11.144153 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:11.144095 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddd7d4874-llmgm_9ef10785-ac21-426b-b187-fa0a3ac4bdc9/kube-auth-proxy/0.log" Jun 05 04:25:11.182869 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:11.182844 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/0.log" Jun 05 04:25:11.215205 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:11.215176 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/1.log" Jun 05 04:25:11.303962 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:11.303928 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jnz2v_5122fb8b-4162-4124-968f-8a6da0fedbcd/payload-processing/0.log" Jun 05 04:25:12.525758 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.525729 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/kube-multus-additional-cni-plugins/0.log" Jun 05 04:25:12.545873 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.545850 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/egress-router-binary-copy/0.log" Jun 05 04:25:12.566961 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.566942 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/cni-plugins/0.log" Jun 05 04:25:12.587569 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.587554 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/bond-cni-plugin/0.log" Jun 05 04:25:12.611625 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.611606 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/routeoverride-cni/0.log" Jun 05 04:25:12.632625 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.632596 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/whereabouts-cni-bincopy/0.log" Jun 05 04:25:12.653657 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.653635 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpkjn_da7b3e0b-25a4-465c-bb29-e75e66c61417/whereabouts-cni/0.log" Jun 05 04:25:12.719118 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.719065 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ntqzv_31489459-370e-4fdb-b6c3-ed1a9bbe3cf4/kube-multus/0.log" Jun 05 04:25:12.740611 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.740561 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4v49z_0d566b68-2109-4850-a2ab-ce18c50a0ce5/network-metrics-daemon/0.log" Jun 05 04:25:12.761450 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.761417 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4v49z_0d566b68-2109-4850-a2ab-ce18c50a0ce5/kube-rbac-proxy/0.log" Jun 05 04:25:12.976576 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.976500 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xd7q_ee60dd12-ba19-4451-a6c1-3029586a3c01/discovery/0.log" Jun 05 04:25:12.985598 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:12.985575 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddd7d4874-llmgm_9ef10785-ac21-426b-b187-fa0a3ac4bdc9/kube-auth-proxy/0.log" Jun 05 04:25:13.024676 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:13.024644 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/0.log" Jun 05 04:25:13.054763 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:13.054734 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ggq44_22a29739-0edd-49c0-8327-e07efb541514/istio-proxy/1.log" Jun 05 04:25:13.146974 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:13.146951 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jnz2v_5122fb8b-4162-4124-968f-8a6da0fedbcd/payload-processing/0.log" Jun 05 04:25:13.999069 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:13.999036 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/ovn-controller/0.log" Jun 05 04:25:14.019484 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.019459 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/ovn-acl-logging/0.log" Jun 05 04:25:14.043671 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.043645 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/kube-rbac-proxy-node/0.log" Jun 05 04:25:14.064216 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.064192 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 04:25:14.080405 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.080383 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/northd/0.log" Jun 05 04:25:14.101676 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.101658 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/nbdb/0.log" Jun 05 04:25:14.121985 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.121970 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/sbdb/0.log" Jun 05 04:25:14.162761 ip-10-0-139-39 kubenswrapper[2551]: I0605 04:25:14.162733 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdw8q_9d8b275f-057f-49a2-83ce-50d011abef47/ovnkube-controller/0.log"