Jun 03 20:43:37.436181 ip-10-0-128-149 systemd[1]: Starting Kubernetes Kubelet... Jun 03 20:43:37.810980 ip-10-0-128-149 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:37.810980 ip-10-0-128-149 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 20:43:37.810980 ip-10-0-128-149 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:37.810980 ip-10-0-128-149 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 20:43:37.810980 ip-10-0-128-149 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:37.812599 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.812514 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 20:43:37.817674 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817658 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.817674 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817674 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817678 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817682 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817685 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817688 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817691 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817694 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817697 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817710 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817713 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817716 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817719 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817722 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817724 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817727 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817730 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817732 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817735 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817737 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.817756 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817742 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817746 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817749 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817751 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817754 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817757 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817759 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817762 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817765 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817770 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817774 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817777 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817779 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817782 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817785 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817787 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817790 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817793 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817795 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817799 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.818225 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817801 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817804 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817806 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817808 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817811 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817813 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817816 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817819 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817821 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817823 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817826 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817829 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817831 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817834 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817837 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817840 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817843 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817846 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817848 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817851 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.818752 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817853 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817856 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817858 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817861 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817863 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817866 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817869 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817872 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817875 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817877 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817880 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817883 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817885 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817888 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817890 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817893 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817895 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817898 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817900 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817903 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.819260 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817905 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817908 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817925 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817930 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817936 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817941 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817944 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817947 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817950 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817953 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817956 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817958 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817961 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817964 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817967 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817970 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817973 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.817976 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818650 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.819730 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818656 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818660 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818662 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818665 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818668 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818671 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818674 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818677 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818679 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818682 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818685 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818688 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818690 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818702 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818706 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818708 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818711 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818714 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818716 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818721 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.820203 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818725 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818728 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818731 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818734 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818737 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818740 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818743 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818746 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818748 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818751 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818754 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818757 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818760 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818763 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818765 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818768 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818770 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818773 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818776 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818779 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.820695 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818782 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818784 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818787 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818789 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818792 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818795 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818798 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818801 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818803 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818806 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818808 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818811 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818814 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818817 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818820 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818822 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818826 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818828 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818831 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818833 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.821241 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818835 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818838 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818840 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818843 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818846 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818848 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818851 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818855 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818858 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818861 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818864 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818867 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818870 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818872 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818876 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818880 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818884 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818887 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818890 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.821738 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818892 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818895 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818898 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818901 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818904 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818907 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818909 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818926 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818930 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818934 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818939 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818941 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818944 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818947 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818950 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818953 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818955 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.818958 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819327 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819332 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.822221 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819335 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819338 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819341 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819343 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819346 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819349 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819352 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819354 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819357 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819360 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819362 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819365 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819368 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819371 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819373 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819376 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819379 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819382 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819385 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819387 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.822721 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819390 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819393 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819395 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819398 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819401 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819403 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819406 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819408 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819411 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819413 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819416 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819418 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819421 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819423 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819426 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819428 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819431 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819434 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819436 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819439 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.823209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819441 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819444 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819446 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819450 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819453 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819456 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819458 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819461 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819464 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819467 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819469 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819471 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819474 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819476 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819479 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819481 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819484 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819486 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819489 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.823701 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819492 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819495 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819497 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819500 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819503 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819505 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819507 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819510 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819512 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819515 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819517 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819520 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819523 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819526 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819528 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819530 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819533 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819536 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819539 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819541 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.824187 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819544 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819547 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819549 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819552 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819555 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819557 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819560 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819562 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819565 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819568 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819572 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819576 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819579 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819582 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819586 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819590 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.819593 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819665 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819680 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819686 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 20:43:37.824676 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819690 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819694 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819697 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819701 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819706 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819709 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819712 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819716 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819719 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819723 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819726 2554 flags.go:64] FLAG: --cgroup-root="" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819729 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819732 2554 flags.go:64] FLAG: --client-ca-file="" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819737 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819741 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819746 2554 flags.go:64] FLAG: --cluster-domain="" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819749 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819752 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819755 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819758 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819762 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819765 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819768 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 20:43:37.825156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819771 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819774 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819777 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819780 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819783 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819786 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819790 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819793 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819796 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819799 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819802 2554 flags.go:64] FLAG: --enable-server="true" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819805 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819809 2554 flags.go:64] FLAG: --event-burst="100" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819812 2554 flags.go:64] FLAG: --event-qps="50" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819815 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819818 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819821 2554 flags.go:64] FLAG: --eviction-hard="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819825 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819828 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819831 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819834 2554 flags.go:64] FLAG: --eviction-soft="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819837 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819842 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819845 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819848 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 20:43:37.825710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819851 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819854 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819857 2554 flags.go:64] FLAG: --feature-gates="" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819863 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819866 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819869 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819872 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819875 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819878 2554 flags.go:64] FLAG: --help="false" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819881 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-128-149.ec2.internal" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819884 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819887 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819890 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819893 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819897 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819900 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819902 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819905 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819908 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819924 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819928 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819930 2554 flags.go:64] FLAG: --kube-reserved="" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819936 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819939 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 20:43:37.826655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819942 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819945 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819948 2554 flags.go:64] FLAG: --lock-file="" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819950 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819953 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819958 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819963 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819966 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819969 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819972 2554 flags.go:64] FLAG: --logging-format="text" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819974 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819978 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819981 2554 flags.go:64] FLAG: --manifest-url="" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819984 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819988 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819991 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819995 2554 flags.go:64] FLAG: --max-pods="110" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.819998 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820001 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820004 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820007 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820010 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820013 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820016 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820022 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 20:43:37.827659 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820025 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820028 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820031 2554 flags.go:64] FLAG: --pod-cidr="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820034 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820039 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820042 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820047 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820049 2554 flags.go:64] FLAG: --port="10250" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820052 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820055 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0fa10f39373d35d" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820058 2554 flags.go:64] FLAG: --qos-reserved="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820061 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820065 2554 flags.go:64] FLAG: --register-node="true" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820068 2554 flags.go:64] FLAG: --register-with-taints="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820072 2554 flags.go:64] FLAG: --registry-burst="10" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820075 2554 flags.go:64] FLAG: --registry-qps="5" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820077 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820080 2554 flags.go:64] FLAG: --reserved-memory="" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820084 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820087 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820090 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820093 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820096 2554 flags.go:64] FLAG: --runonce="false" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820099 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820102 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 20:43:37.828316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820104 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820107 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820110 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820113 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820116 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820119 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820122 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820125 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820127 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820130 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820133 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820136 2554 flags.go:64] FLAG: --system-cgroups="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820139 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820145 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820151 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820154 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820159 2554 flags.go:64] FLAG: --tls-min-version="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820162 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820165 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820169 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820172 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820175 2554 flags.go:64] FLAG: --v="2" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820179 2554 flags.go:64] FLAG: --version="false" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820183 2554 flags.go:64] FLAG: --vmodule="" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820186 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 20:43:37.828978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.820190 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820305 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820308 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820311 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820315 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820318 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820320 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820323 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820326 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820328 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820331 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820334 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820336 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820339 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820341 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820344 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820348 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820351 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820354 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.829580 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820357 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820361 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820364 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820367 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820370 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820373 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820376 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820380 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820383 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820386 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820389 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820391 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820394 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820397 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820400 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820402 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820405 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820408 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820410 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820413 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.830078 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820415 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820418 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820420 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820423 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820425 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820428 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820430 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820433 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820436 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820439 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820442 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820444 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820448 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820452 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820455 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820458 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820461 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820463 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820466 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.830568 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820469 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820471 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820474 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820476 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820479 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820482 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820484 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820487 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820490 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820492 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820495 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820498 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820500 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820503 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820506 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820508 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820511 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820513 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820516 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820518 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.831069 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820522 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820525 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820528 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820531 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820534 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820537 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820541 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820544 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820546 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820549 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820552 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820555 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820558 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820560 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820563 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820566 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820568 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820571 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820574 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820576 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.831552 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.820579 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.821068 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.828899 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.828928 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.829632 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.829639 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829697 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829703 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829706 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829709 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829712 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829715 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829718 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829721 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.832144 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829725 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829729 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829732 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829735 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829738 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829740 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829743 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829745 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829748 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829751 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829753 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829756 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829759 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829761 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829764 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829768 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829772 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829775 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829778 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829782 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.832494 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829785 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829789 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829792 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829795 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829797 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829801 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829804 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829807 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829810 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829812 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829815 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829819 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829822 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829825 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829828 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829831 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829834 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829837 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829840 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.833049 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829843 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829846 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829849 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829851 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829854 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829857 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829861 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829864 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829866 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829869 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829872 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829874 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829877 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829879 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829882 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829884 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829887 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829890 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829892 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829894 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.833546 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829897 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829899 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829902 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829904 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829907 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829910 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829927 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829930 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829933 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829935 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829938 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829941 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829945 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829947 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829950 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829953 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829956 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829958 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829961 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829963 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.834041 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829966 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829969 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829971 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829974 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829977 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829979 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829982 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829984 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829987 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829990 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.829992 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.829997 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830104 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830110 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830113 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:37.834844 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830116 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830119 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830122 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830124 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830127 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830130 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830132 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830135 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830138 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830141 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830145 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830148 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830152 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830156 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830159 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830161 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830164 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830167 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830170 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:37.835447 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830173 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830176 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830179 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830181 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830184 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830186 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830189 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830192 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830194 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830197 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830200 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830202 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830205 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830207 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830210 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830213 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830215 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830218 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830220 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830223 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:37.835936 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830225 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830228 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830231 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830233 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830237 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830240 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830242 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830244 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830247 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830249 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830252 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830254 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830257 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830259 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830262 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830264 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830267 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830269 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830272 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830274 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:37.836592 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830277 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830279 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830281 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830284 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830288 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830291 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830294 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830297 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830300 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830302 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830305 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830308 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830310 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830313 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830315 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830318 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830321 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830324 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830326 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:37.837485 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830329 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830332 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830334 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830337 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830341 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830344 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830346 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830349 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830352 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830354 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830357 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830359 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830362 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830364 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830367 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830369 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:37.838008 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:37.830371 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.830376 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.830471 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.832775 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.834128 2554 server.go:1019] "Starting client certificate rotation" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.834247 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.834290 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.836369 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:37.838441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.837530 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:37.848269 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.848254 2554 log.go:25] "Validated CRI v1 runtime API" Jun 03 20:43:37.852447 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.852431 2554 log.go:25] "Validated CRI v1 image API" Jun 03 20:43:37.854431 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.854417 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 20:43:37.858097 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.858073 2554 fs.go:135] Filesystem UUIDs: map[323456df-0795-41ac-8e2c-c87d1f01e92c:/dev/nvme0n1p3 37ebcc41-a2ae-40d4-b049-1936b3274f56:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 20:43:37.858165 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.858096 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 20:43:37.862673 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.862568 2554 manager.go:216] Machine: {Timestamp:2026-06-03 20:43:37.861481372 +0000 UTC m=+0.314926309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099942 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec240694ac90394303ea86812844b4f0 SystemUUID:ec240694-ac90-3943-03ea-86812844b4f0 BootID:89dbcdf4-cd67-4dd5-aa24-65e2e35cbd21 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:6c:cb:48:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:6c:cb:48:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:18:1a:fb:2a:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 20:43:37.862673 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.862671 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 20:43:37.862795 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.862779 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 20:43:37.864883 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.864851 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 20:43:37.865290 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.864932 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 20:43:37.866001 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.865986 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:37.866176 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.866163 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 20:43:37.866219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.866178 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 20:43:37.866219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.866186 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:37.866772 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.866761 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:37.867425 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.867416 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 20:43:37.870014 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870003 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:37.870125 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870116 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 20:43:37.870154 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870145 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 03 20:43:37.870184 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870154 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 20:43:37.870184 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870168 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 20:43:37.870184 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870177 2554 kubelet.go:398] "Adding apiserver pod source" Jun 03 20:43:37.870184 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870185 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 20:43:37.870571 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870560 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:37.870613 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.870579 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:37.872581 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.872566 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 20:43:37.873738 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.873725 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 20:43:37.873778 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.873757 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 20:43:37.874268 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874256 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 20:43:37.874300 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874274 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 20:43:37.874300 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874280 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 20:43:37.874300 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874286 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 20:43:37.874300 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874295 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874303 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874326 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874332 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874338 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874343 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874351 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 20:43:37.874411 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874359 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 20:43:37.875000 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.874988 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 20:43:37.875033 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.875002 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 20:43:37.878272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.878258 2554 server.go:1268] "Started kubelet" Jun 03 20:43:37.878342 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.878305 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 20:43:37.878500 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.878448 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 20:43:37.878561 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.878552 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 20:43:37.879281 ip-10-0-128-149 systemd[1]: Started Kubernetes Kubelet. Jun 03 20:43:37.879884 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.879613 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 20:43:37.880197 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.880149 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 03 20:43:37.880637 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.880615 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 20:43:37.880752 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.880732 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 20:43:37.880752 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.880741 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 20:43:37.885711 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.885538 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 20:43:37.886245 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.885590 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:37.886245 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.885941 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:37.886604 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.886569 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 20:43:37.886746 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.886730 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 20:43:37.886810 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.886757 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 20:43:37.886810 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.886767 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 20:43:37.886937 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.886888 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 03 20:43:37.886937 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.886901 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 03 20:43:37.887052 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.887037 2554 factory.go:55] Registering systemd factory Jun 03 20:43:37.887052 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.887053 2554 factory.go:223] Registration of the systemd container factory successfully Jun 03 20:43:37.887876 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.887858 2554 factory.go:153] Registering CRI-O factory Jun 03 20:43:37.887876 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.887878 2554 factory.go:223] Registration of the crio container factory successfully Jun 03 20:43:37.888048 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.887990 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 20:43:37.888048 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.888019 2554 factory.go:103] Registering Raw factory Jun 03 20:43:37.888048 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.888034 2554 manager.go:1196] Started watching for new ooms in manager Jun 03 20:43:37.888304 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.887347 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1a512c7e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.878228094 +0000 UTC m=+0.331673016,LastTimestamp:2026-06-03 20:43:37.878228094 +0000 UTC m=+0.331673016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.888521 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.888395 2554 manager.go:349] Starting recovery of all containers Jun 03 20:43:37.897692 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.897667 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 20:43:37.897807 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.897688 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 20:43:37.900356 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.900343 2554 manager.go:354] Recovery completed Jun 03 20:43:37.904102 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.904088 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:37.905745 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.905730 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:37.905792 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.905761 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:37.905792 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.905775 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:37.906263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906243 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 20:43:37.906263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906255 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:37.906397 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906257 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 20:43:37.906397 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906294 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:37.906891 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906877 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:37.906965 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906901 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:37.906965 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.906938 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:37.907565 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.907552 2554 policy_none.go:49] "None policy: Start" Jun 03 20:43:37.907615 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.907571 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 20:43:37.907615 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.907584 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 20:43:37.908486 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.908473 2554 policy_none.go:47] "Start" Jun 03 20:43:37.915272 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.915207 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf51397 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905746839 +0000 UTC m=+0.359191760,LastTimestamp:2026-06-03 20:43:37.905746839 +0000 UTC m=+0.359191760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.924028 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.923953 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf56764 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905768292 +0000 UTC m=+0.359213208,LastTimestamp:2026-06-03 20:43:37.905768292 +0000 UTC m=+0.359213208,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.933269 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.933206 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf592db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905779419 +0000 UTC m=+0.359224335,LastTimestamp:2026-06-03 20:43:37.905779419 +0000 UTC m=+0.359224335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.939899 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.939841 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-149.ec2.internal.18b5acfa1bf51397\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf51397 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905746839 +0000 UTC m=+0.359191760,LastTimestamp:2026-06-03 20:43:37.906889434 +0000 UTC m=+0.360334350,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944145 2554 manager.go:337] "Starting Device Plugin manager" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.944207 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944217 2554 server.go:87] "Starting device plugin registration server" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944420 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944433 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944519 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944593 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.944601 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.945144 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.945194 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.949504 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-149.ec2.internal.18b5acfa1bf56764\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf56764 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905768292 +0000 UTC m=+0.359213208,LastTimestamp:2026-06-03 20:43:37.906905792 +0000 UTC m=+0.360350708,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.951876 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.953159 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.953190 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.953209 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 20:43:37.955131 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.953238 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 20:43:37.960207 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.960150 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-149.ec2.internal.18b5acfa1bf592db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1bf592db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.905779419 +0000 UTC m=+0.359224335,LastTimestamp:2026-06-03 20:43:37.906970181 +0000 UTC m=+0.360415096,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.960324 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.960207 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 03 20:43:37.965306 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.965290 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkltb" Jun 03 20:43:37.969971 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:37.969900 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18b5acfa1edac2cf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-06-03 20:43:37.954353871 +0000 UTC m=+0.407798780,LastTimestamp:2026-06-03 20:43:37.954353871 +0000 UTC m=+0.407798780,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}" Jun 03 20:43:37.977464 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:37.977442 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkltb" Jun 03 20:43:38.045146 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.045123 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:38.046038 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.046022 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:38.046135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.046055 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:38.046135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.046069 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:38.046135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.046100 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.054182 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.054153 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"] Jun 03 20:43:38.054256 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.054221 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:38.055537 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.055518 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:38.055619 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.055545 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:38.055619 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.055554 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:38.056658 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.056645 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:38.056767 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.056753 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.056811 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.056782 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:38.057383 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057369 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:38.057443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057400 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:38.057443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057370 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:38.057504 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057449 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:38.057504 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057415 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:38.057504 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.057463 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:38.058505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.058489 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.058588 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.058512 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:38.059156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.059135 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:38.059248 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.059170 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:38.059248 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.059187 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:38.063148 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.063124 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.063198 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.063159 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-149.ec2.internal\": node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.086209 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.086194 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-149.ec2.internal\" not found" node="ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.087055 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.087039 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.087127 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.087061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f9974b03393a4242e374df7239145d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"11f9974b03393a4242e374df7239145d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.087127 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.087077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.090676 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.090662 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-149.ec2.internal\" not found" node="ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.090802 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.090787 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.187723 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.187834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.187834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187738 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.187834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f9974b03393a4242e374df7239145d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"11f9974b03393a4242e374df7239145d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.187834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187771 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f9974b03393a4242e374df7239145d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"11f9974b03393a4242e374df7239145d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.187834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.187771 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44315d963e4fff058800ef8bf0713ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"44315d963e4fff058800ef8bf0713ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.191779 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.191764 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.291847 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.291811 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.389550 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.389493 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.393331 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.391868 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.394165 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.393511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.492696 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.492662 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.593101 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.593074 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.693689 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.693626 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found" Jun 03 20:43:38.775966 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.775940 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:38.786713 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.786685 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.796564 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.796544 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:38.797654 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.797642 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" Jun 03 20:43:38.805341 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.805329 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:38.820644 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.820625 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:38.833415 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.833395 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 20:43:38.833557 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.833537 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:38.833601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.833548 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:38.870719 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.870680 2554 apiserver.go:52] "Watching apiserver" Jun 03 20:43:38.883839 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.883813 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 20:43:38.885017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.884995 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-tgsj5","kube-system/global-pull-secret-syncer-jwdsl","kube-system/konnectivity-agent-9tsbg","openshift-dns/node-resolver-vstwg","openshift-image-registry/node-ca-xgt7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal","openshift-multus/multus-wszwv","openshift-multus/network-metrics-daemon-x5c7b","openshift-network-diagnostics/network-check-target-jwx84","kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7","openshift-cluster-node-tuning-operator/tuned-rwkgf","openshift-multus/multus-additional-cni-plugins-tt7d7","openshift-network-operator/iptables-alerter-ptg2q"] Jun 03 20:43:38.886347 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.886330 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:38.886416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.886375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.887551 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.887534 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.887649 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.887612 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:38.888257 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888239 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 20:43:38.888421 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888405 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.888487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888407 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.888487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 20:43:38.888487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9j6ks\"" Jun 03 20:43:38.888906 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888892 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 20:43:38.888982 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.888961 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 20:43:38.889695 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.889681 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:38.890732 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.890711 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:38.891023 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.890996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f6a021-3de1-4341-838f-95b5b3235256-ovn-node-metrics-cert\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891143 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-script-lib\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891143 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-systemd-units\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-netns\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891193 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-log-socket\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891181 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-etc-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891263 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891257 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-ovn\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-bin\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-dbus\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891417 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ggq4d\"" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-systemd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-var-lib-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891454 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-node-log\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891499 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-config\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmdsg\" (UniqueName: \"kubernetes.io/projected/a1f6a021-3de1-4341-838f-95b5b3235256-kube-api-access-hmdsg\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.891548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-kubelet-config\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.892017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-kubelet\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.892017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-slash\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.892017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-netd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.892017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.891685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-env-overrides\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.892171 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.892060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:38.892220 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.892189 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.892831 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.892813 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.893079 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.893065 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wwzjz\"" Jun 03 20:43:38.893193 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.893178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.894214 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.894199 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:38.894304 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.894278 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:38.895371 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.895353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:38.895468 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.895407 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:38.896684 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.896668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.897381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.897225 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.897381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.897237 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 20:43:38.897381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.897255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.897675 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.897401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.897675 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.897525 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 20:43:38.898041 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.898021 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.898143 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.898127 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.898539 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.898519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnm7m\"" Jun 03 20:43:38.898802 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.898786 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 20:43:38.899879 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.899545 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 20:43:38.899879 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.899561 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.899879 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.899812 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qckfb\"" Jun 03 20:43:38.900313 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.900292 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.900368 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.900353 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.900875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.900502 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2k7cc\"" Jun 03 20:43:38.900875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.900648 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jgl4\"" Jun 03 20:43:38.900875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.900729 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.901775 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.901304 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:38.902231 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.902212 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-crk9d\"" Jun 03 20:43:38.902327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.902242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.902327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.902259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 20:43:38.902327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.902242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 20:43:38.902583 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.902566 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:38.903380 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.903234 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hgmjt\"" Jun 03 20:43:38.903483 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.903468 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 20:43:38.903822 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.903806 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:38.903980 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.903959 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:38.915180 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.915162 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:38.923338 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.923322 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gslk" Jun 03 20:43:38.931247 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.931230 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gslk" Jun 03 20:43:38.937777 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:38.937754 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f9974b03393a4242e374df7239145d.slice/crio-b30bf1cad92289312e9a222c1cb6f91dfc0bbb5447c073f26c54719d52662aa0 WatchSource:0}: Error finding container b30bf1cad92289312e9a222c1cb6f91dfc0bbb5447c073f26c54719d52662aa0: Status 404 returned error can't find the container with id b30bf1cad92289312e9a222c1cb6f91dfc0bbb5447c073f26c54719d52662aa0 Jun 03 20:43:38.938188 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:38.938171 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44315d963e4fff058800ef8bf0713ba7.slice/crio-c350e488807c7a542b3e83b9ffc4ef21b994603f8901a33bdca59ef2d0c4d488 WatchSource:0}: Error finding container c350e488807c7a542b3e83b9ffc4ef21b994603f8901a33bdca59ef2d0c4d488: Status 404 returned error can't find the container with id c350e488807c7a542b3e83b9ffc4ef21b994603f8901a33bdca59ef2d0c4d488 Jun 03 20:43:38.944877 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.944860 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:43:38.956291 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.956259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"44315d963e4fff058800ef8bf0713ba7","Type":"ContainerStarted","Data":"c350e488807c7a542b3e83b9ffc4ef21b994603f8901a33bdca59ef2d0c4d488"} Jun 03 20:43:38.957399 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.957319 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" event={"ID":"11f9974b03393a4242e374df7239145d","Type":"ContainerStarted","Data":"b30bf1cad92289312e9a222c1cb6f91dfc0bbb5447c073f26c54719d52662aa0"} Jun 03 20:43:38.979993 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.979955 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:38:37 +0000 UTC" deadline="2028-01-06 07:42:10.434287751 +0000 UTC" Jun 03 20:43:38.979993 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.979990 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13954h58m31.454300209s" Jun 03 20:43:38.987623 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.987606 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 20:43:38.992193 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992172 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hsnj\" (UniqueName: \"kubernetes.io/projected/95432a1e-1f67-4a78-b754-2cce86e5e153-kube-api-access-5hsnj\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.992281 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-kubelet\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992281 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-env-overrides\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992281 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f6a021-3de1-4341-838f-95b5b3235256-ovn-node-metrics-cert\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992281 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b391488a-1b65-4db1-8e08-dd002ab4544c-agent-certs\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:38.992443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992279 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-kubelet\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbd75ac-7c83-42c6-8d22-95cef227c93e-hosts-file\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:38.992443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-host\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:38.992443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-serviceca\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:38.992443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-socket-dir-parent\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-hostroot\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-687jj\" (UniqueName: \"kubernetes.io/projected/811b3128-3350-4fa9-bac8-c63ffe694983-kube-api-access-687jj\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992555 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-run\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992591 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 20:43:38.992601 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-bin\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992851 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-env-overrides\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.992851 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992661 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-bin\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.992625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bp8z\" (UniqueName: \"kubernetes.io/projected/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-kube-api-access-5bp8z\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:38.993105 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993077 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-node-log\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993105 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-system-cni-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.993186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-daemon-config\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-script-lib\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-kubernetes\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.993186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-tmp\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.993186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-netns\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993184 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-node-log\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993209 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-netns\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-multus\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993370 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993416 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.993409 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjz9t\" (UniqueName: \"kubernetes.io/projected/e0c53928-22ae-420f-802e-5481b5c282e7-kube-api-access-sjz9t\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-multus-certs\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysconfig\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:38.993515 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.493494691 +0000 UTC m=+1.946939598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-conf\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cnibin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993595 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-script-lib\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-systemd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-var-lib-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-systemd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbd75ac-7c83-42c6-8d22-95cef227c93e-tmp-dir\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-k8s-cni-cncf-io\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-kubelet\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-var-lib-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.993757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-modprobe-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993739 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-netd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfxqw\" (UniqueName: \"kubernetes.io/projected/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-kube-api-access-hfxqw\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-conf-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993790 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-cni-netd\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-systemd-units\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-log-socket\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-host-slash\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993908 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-systemd-units\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vlj\" (UniqueName: \"kubernetes.io/projected/fdbd75ac-7c83-42c6-8d22-95cef227c93e-kube-api-access-75vlj\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-log-socket\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-etc-kubernetes\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.993980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-systemd\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-host\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-etc-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-ovn\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-dbus\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.994505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-registration-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-os-release\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994154 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-system-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-bin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994243 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-ovn\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-config\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-cnibin\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994331 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-netns\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-sys\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-lib-modules\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-var-lib-kubelet\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-slash\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-sys-fs\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.995086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994517 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-host-slash\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pt4\" (UniqueName: \"kubernetes.io/projected/e915fdfd-d1f6-467b-96ec-411a671ef8de-kube-api-access-c5pt4\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994614 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-etc-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994706 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b391488a-1b65-4db1-8e08-dd002ab4544c-konnectivity-ca\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f6a021-3de1-4341-838f-95b5b3235256-ovnkube-config\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-socket-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994745 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-dbus\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994741 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f6a021-3de1-4341-838f-95b5b3235256-run-openvswitch\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cni-binary-copy\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5dts\" (UniqueName: \"kubernetes.io/projected/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-kube-api-access-z5dts\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-tuned\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdsg\" (UniqueName: \"kubernetes.io/projected/a1f6a021-3de1-4341-838f-95b5b3235256-kube-api-access-hmdsg\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-kubelet-config\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.995575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-iptables-alerter-script\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:38.996051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-device-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:38.996051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-os-release\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:38.996051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:38.996051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.994954 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff4710bf-8cde-4917-8db9-29e35c12d574-kubelet-config\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:38.996051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:38.995499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f6a021-3de1-4341-838f-95b5b3235256-ovn-node-metrics-cert\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:39.003249 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.003227 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdsg\" (UniqueName: \"kubernetes.io/projected/a1f6a021-3de1-4341-838f-95b5b3235256-kube-api-access-hmdsg\") pod \"ovnkube-node-tgsj5\" (UID: \"a1f6a021-3de1-4341-838f-95b5b3235256\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:39.095193 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-host-slash\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.095315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vlj\" (UniqueName: \"kubernetes.io/projected/fdbd75ac-7c83-42c6-8d22-95cef227c93e-kube-api-access-75vlj\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.095315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-etc-kubernetes\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-systemd\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095269 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-etc-kubernetes\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095273 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-host-slash\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-host\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-registration-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-systemd\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-os-release\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-system-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095435 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-registration-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095409 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-host\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-bin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095492 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-bin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095498 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-system-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095500 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-cnibin\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095530 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-netns\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095528 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-os-release\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-sys\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095564 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-netns\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095572 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-cnibin\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-lib-modules\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095610 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-sys\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-var-lib-kubelet\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-sys-fs\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095688 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-var-lib-kubelet\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095693 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-lib-modules\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095720 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-sys-fs\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pt4\" (UniqueName: \"kubernetes.io/projected/e915fdfd-d1f6-467b-96ec-411a671ef8de-kube-api-access-c5pt4\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.095827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095742 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b391488a-1b65-4db1-8e08-dd002ab4544c-konnectivity-ca\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-socket-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cni-binary-copy\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5dts\" (UniqueName: \"kubernetes.io/projected/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-kube-api-access-z5dts\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-tuned\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-socket-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-iptables-alerter-script\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095974 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.095987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-device-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-os-release\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hsnj\" (UniqueName: \"kubernetes.io/projected/95432a1e-1f67-4a78-b754-2cce86e5e153-kube-api-access-5hsnj\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096073 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0c53928-22ae-420f-802e-5481b5c282e7-device-dir\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b391488a-1b65-4db1-8e08-dd002ab4544c-agent-certs\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:39.096653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbd75ac-7c83-42c6-8d22-95cef227c93e-hosts-file\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-host\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-serviceca\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096174 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-socket-dir-parent\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096221 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-hostroot\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-687jj\" (UniqueName: \"kubernetes.io/projected/811b3128-3350-4fa9-bac8-c63ffe694983-kube-api-access-687jj\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096289 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-run\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bp8z\" (UniqueName: \"kubernetes.io/projected/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-kube-api-access-5bp8z\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-system-cni-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.096351 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-daemon-config\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-kubernetes\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.096414 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.596394538 +0000 UTC m=+2.049839441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096440 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-kubernetes\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096441 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-tmp\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.097536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096508 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-iptables-alerter-script\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096508 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cni-binary-copy\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-multus\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096571 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-hostroot\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjz9t\" (UniqueName: \"kubernetes.io/projected/e0c53928-22ae-420f-802e-5481b5c282e7-kube-api-access-sjz9t\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096652 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-host\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-multus-certs\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096655 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-cni-multus\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysconfig\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096708 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-os-release\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-conf\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096738 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbd75ac-7c83-42c6-8d22-95cef227c93e-hosts-file\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cnibin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096772 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-socket-dir-parent\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.098505 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096786 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-run\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbd75ac-7c83-42c6-8d22-95cef227c93e-tmp-dir\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096818 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysconfig\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-k8s-cni-cncf-io\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-kubelet\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-modprobe-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfxqw\" (UniqueName: \"kubernetes.io/projected/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-kube-api-access-hfxqw\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-conf-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096981 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.096994 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-multus-certs\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097016 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-conf-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097055 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e915fdfd-d1f6-467b-96ec-411a671ef8de-system-cni-dir\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-cni-dir\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097164 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-run-k8s-cni-cncf-io\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097186 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-sysctl-conf\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097397 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-cnibin\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097527 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b391488a-1b65-4db1-8e08-dd002ab4544c-konnectivity-ca\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097636 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-modprobe-d\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097533 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097667 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbd75ac-7c83-42c6-8d22-95cef227c93e-tmp-dir\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097689 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-host-var-lib-kubelet\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.097856 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-multus-daemon-config\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.098290 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e915fdfd-d1f6-467b-96ec-411a671ef8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.098359 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-serviceca\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.098712 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-etc-tuned\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.098754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95432a1e-1f67-4a78-b754-2cce86e5e153-tmp\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.099683 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.098784 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b391488a-1b65-4db1-8e08-dd002ab4544c-agent-certs\") pod \"konnectivity-agent-9tsbg\" (UID: \"b391488a-1b65-4db1-8e08-dd002ab4544c\") " pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:39.102605 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.102585 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vlj\" (UniqueName: \"kubernetes.io/projected/fdbd75ac-7c83-42c6-8d22-95cef227c93e-kube-api-access-75vlj\") pod \"node-resolver-vstwg\" (UID: \"fdbd75ac-7c83-42c6-8d22-95cef227c93e\") " pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.105105 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.105086 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:39.105105 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.105108 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:39.105280 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.105118 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.105280 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.105202 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.605182694 +0000 UTC m=+2.058627597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.106072 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.106029 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5dts\" (UniqueName: \"kubernetes.io/projected/63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1-kube-api-access-z5dts\") pod \"multus-wszwv\" (UID: \"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1\") " pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.106376 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.106354 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hsnj\" (UniqueName: \"kubernetes.io/projected/95432a1e-1f67-4a78-b754-2cce86e5e153-kube-api-access-5hsnj\") pod \"tuned-rwkgf\" (UID: \"95432a1e-1f67-4a78-b754-2cce86e5e153\") " pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.106464 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.106422 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pt4\" (UniqueName: \"kubernetes.io/projected/e915fdfd-d1f6-467b-96ec-411a671ef8de-kube-api-access-c5pt4\") pod \"multus-additional-cni-plugins-tt7d7\" (UID: \"e915fdfd-d1f6-467b-96ec-411a671ef8de\") " pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.106523 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.106507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bp8z\" (UniqueName: \"kubernetes.io/projected/67dcc848-e2b1-47dc-b90a-ebed8fd67fd0-kube-api-access-5bp8z\") pod \"iptables-alerter-ptg2q\" (UID: \"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0\") " pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.107344 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.107325 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfxqw\" (UniqueName: \"kubernetes.io/projected/73b5fab7-1a3f-4e57-84a3-58d1b7340f23-kube-api-access-hfxqw\") pod \"node-ca-xgt7r\" (UID: \"73b5fab7-1a3f-4e57-84a3-58d1b7340f23\") " pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.107974 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.107957 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-687jj\" (UniqueName: \"kubernetes.io/projected/811b3128-3350-4fa9-bac8-c63ffe694983-kube-api-access-687jj\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:39.108049 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.107957 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjz9t\" (UniqueName: \"kubernetes.io/projected/e0c53928-22ae-420f-802e-5481b5c282e7-kube-api-access-sjz9t\") pod \"aws-ebs-csi-driver-node-wt9b7\" (UID: \"e0c53928-22ae-420f-802e-5481b5c282e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.205899 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.205832 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:43:39.214496 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.214477 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f6a021_3de1_4341_838f_95b5b3235256.slice/crio-84017e1dd1a20e895190ccfc10451a4317b1fd5d27b750e47e795362d6e54bf9 WatchSource:0}: Error finding container 84017e1dd1a20e895190ccfc10451a4317b1fd5d27b750e47e795362d6e54bf9: Status 404 returned error can't find the container with id 84017e1dd1a20e895190ccfc10451a4317b1fd5d27b750e47e795362d6e54bf9 Jun 03 20:43:39.222183 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.222164 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:43:39.229769 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.229749 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb391488a_1b65_4db1_8e08_dd002ab4544c.slice/crio-a58093b211c8f8584693c4d576b73cea6ac632543f52391f157ce4e11c71eca1 WatchSource:0}: Error finding container a58093b211c8f8584693c4d576b73cea6ac632543f52391f157ce4e11c71eca1: Status 404 returned error can't find the container with id a58093b211c8f8584693c4d576b73cea6ac632543f52391f157ce4e11c71eca1 Jun 03 20:43:39.245314 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.245289 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vstwg" Jun 03 20:43:39.248926 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.248896 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgt7r" Jun 03 20:43:39.253900 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.253881 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wszwv" Jun 03 20:43:39.254428 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.254408 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbd75ac_7c83_42c6_8d22_95cef227c93e.slice/crio-3d999c90ffd930f78ca2e18ba492fa46f0477ddbe36c3a29b7d94c36a3103ecb WatchSource:0}: Error finding container 3d999c90ffd930f78ca2e18ba492fa46f0477ddbe36c3a29b7d94c36a3103ecb: Status 404 returned error can't find the container with id 3d999c90ffd930f78ca2e18ba492fa46f0477ddbe36c3a29b7d94c36a3103ecb Jun 03 20:43:39.257343 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.257313 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b5fab7_1a3f_4e57_84a3_58d1b7340f23.slice/crio-16cd2789de5d75fa4a27fdc2913c2374ea0780918373396f25144f24d63925c0 WatchSource:0}: Error finding container 16cd2789de5d75fa4a27fdc2913c2374ea0780918373396f25144f24d63925c0: Status 404 returned error can't find the container with id 16cd2789de5d75fa4a27fdc2913c2374ea0780918373396f25144f24d63925c0 Jun 03 20:43:39.260573 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.260557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" Jun 03 20:43:39.261954 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.261936 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fcc97d_00e8_4aaf_a8a6_efeb3ece2ab1.slice/crio-1e53562ac6a237c12940aef928f8a09699c94dc648934701dea25e564da4482a WatchSource:0}: Error finding container 1e53562ac6a237c12940aef928f8a09699c94dc648934701dea25e564da4482a: Status 404 returned error can't find the container with id 1e53562ac6a237c12940aef928f8a09699c94dc648934701dea25e564da4482a Jun 03 20:43:39.265608 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.265594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" Jun 03 20:43:39.266595 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.266564 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:39.269693 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.269668 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c53928_22ae_420f_802e_5481b5c282e7.slice/crio-85c6538e8c05c8de0028badcd37888caa64976d66831758f753e6dade0b057e6 WatchSource:0}: Error finding container 85c6538e8c05c8de0028badcd37888caa64976d66831758f753e6dade0b057e6: Status 404 returned error can't find the container with id 85c6538e8c05c8de0028badcd37888caa64976d66831758f753e6dade0b057e6 Jun 03 20:43:39.270346 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.270330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" Jun 03 20:43:39.274209 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.274009 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95432a1e_1f67_4a78_b754_2cce86e5e153.slice/crio-04dad08f9182ffedbcb38550065ff5b3433fde73fac871561565abf263538921 WatchSource:0}: Error finding container 04dad08f9182ffedbcb38550065ff5b3433fde73fac871561565abf263538921: Status 404 returned error can't find the container with id 04dad08f9182ffedbcb38550065ff5b3433fde73fac871561565abf263538921 Jun 03 20:43:39.275595 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.275498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptg2q" Jun 03 20:43:39.279301 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.279285 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode915fdfd_d1f6_467b_96ec_411a671ef8de.slice/crio-a33f646f18b0c3c1db3562b5eae9b6af5e3d29a9a1dd47d02d71acabf4435d71 WatchSource:0}: Error finding container a33f646f18b0c3c1db3562b5eae9b6af5e3d29a9a1dd47d02d71acabf4435d71: Status 404 returned error can't find the container with id a33f646f18b0c3c1db3562b5eae9b6af5e3d29a9a1dd47d02d71acabf4435d71 Jun 03 20:43:39.284671 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:43:39.284649 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dcc848_e2b1_47dc_b90a_ebed8fd67fd0.slice/crio-8446e29b5919d193cce0b99699db33b6093f12df38ba6f207fbff4158f9075cd WatchSource:0}: Error finding container 8446e29b5919d193cce0b99699db33b6093f12df38ba6f207fbff4158f9075cd: Status 404 returned error can't find the container with id 8446e29b5919d193cce0b99699db33b6093f12df38ba6f207fbff4158f9075cd Jun 03 20:43:39.500280 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.500152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:39.500435 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.500370 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:39.500435 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.500431 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:40.500413897 +0000 UTC m=+2.953858801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:39.602005 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.601380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:39.602005 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.601571 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.602005 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.601633 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:40.601613477 +0000 UTC m=+3.055058389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.702439 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.701843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:39.702439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.702013 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:39.702439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.702035 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:39.702439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.702049 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.702439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.702107 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:43:40.702089634 +0000 UTC m=+3.155534536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.933586 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.933425 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:38 +0000 UTC" deadline="2028-01-19 15:36:56.484306237 +0000 UTC" Jun 03 20:43:39.933586 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.933456 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14274h53m16.550854833s" Jun 03 20:43:39.954961 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.954399 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:39.954961 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:39.954525 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:39.975228 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.975148 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerStarted","Data":"a33f646f18b0c3c1db3562b5eae9b6af5e3d29a9a1dd47d02d71acabf4435d71"} Jun 03 20:43:39.988332 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.988252 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" event={"ID":"95432a1e-1f67-4a78-b754-2cce86e5e153","Type":"ContainerStarted","Data":"04dad08f9182ffedbcb38550065ff5b3433fde73fac871561565abf263538921"} Jun 03 20:43:39.997255 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:39.997167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" event={"ID":"e0c53928-22ae-420f-802e-5481b5c282e7","Type":"ContainerStarted","Data":"85c6538e8c05c8de0028badcd37888caa64976d66831758f753e6dade0b057e6"} Jun 03 20:43:40.017865 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.017825 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wszwv" event={"ID":"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1","Type":"ContainerStarted","Data":"1e53562ac6a237c12940aef928f8a09699c94dc648934701dea25e564da4482a"} Jun 03 20:43:40.050630 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.050593 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vstwg" event={"ID":"fdbd75ac-7c83-42c6-8d22-95cef227c93e","Type":"ContainerStarted","Data":"3d999c90ffd930f78ca2e18ba492fa46f0477ddbe36c3a29b7d94c36a3103ecb"} Jun 03 20:43:40.059983 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.059862 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tsbg" event={"ID":"b391488a-1b65-4db1-8e08-dd002ab4544c","Type":"ContainerStarted","Data":"a58093b211c8f8584693c4d576b73cea6ac632543f52391f157ce4e11c71eca1"} Jun 03 20:43:40.068904 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.068820 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptg2q" event={"ID":"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0","Type":"ContainerStarted","Data":"8446e29b5919d193cce0b99699db33b6093f12df38ba6f207fbff4158f9075cd"} Jun 03 20:43:40.082632 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.082607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgt7r" event={"ID":"73b5fab7-1a3f-4e57-84a3-58d1b7340f23","Type":"ContainerStarted","Data":"16cd2789de5d75fa4a27fdc2913c2374ea0780918373396f25144f24d63925c0"} Jun 03 20:43:40.093548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.093423 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"84017e1dd1a20e895190ccfc10451a4317b1fd5d27b750e47e795362d6e54bf9"} Jun 03 20:43:40.508840 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.508807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:40.509045 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.509002 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:40.509122 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.509066 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:42.509046444 +0000 UTC m=+4.962491364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:40.609642 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.609595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:40.609824 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.609788 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:40.609899 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.609851 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:42.609832334 +0000 UTC m=+5.063277242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:40.710970 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.710330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:40.710970 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.710519 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:40.710970 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.710537 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:40.710970 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.710549 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:40.710970 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.710601 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:43:42.710582717 +0000 UTC m=+5.164027637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:40.934585 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.934454 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:38 +0000 UTC" deadline="2028-01-18 23:41:50.646392428 +0000 UTC" Jun 03 20:43:40.934585 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.934510 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14258h58m9.711886389s" Jun 03 20:43:40.954107 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.954072 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:40.954266 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.954196 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:40.954599 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:40.954574 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:40.954720 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:40.954662 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:41.101578 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:41.101348 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:41.714665 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:41.714385 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:41.956126 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:41.956098 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:41.956597 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:41.956224 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:42.524782 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:42.524114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:42.524782 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.524377 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:42.524782 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.524453 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:46.524433939 +0000 UTC m=+8.977878849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:42.624627 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:42.624588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:42.624806 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.624732 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:42.624806 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.624801 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:46.624782928 +0000 UTC m=+9.078227844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:42.725341 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:42.725302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:42.725522 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.725501 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:42.725522 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.725521 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:42.725630 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.725534 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:42.725630 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.725596 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:43:46.72557831 +0000 UTC m=+9.179023213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:42.953866 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:42.953555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:42.953866 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.953689 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:42.953866 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:42.953749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:42.954158 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:42.953863 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:43.954631 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:43.954288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:43.954631 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:43.954413 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:44.953588 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:44.953557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:44.953772 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:44.953693 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:44.954010 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:44.953936 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:44.954092 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:44.954024 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:45.956219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:45.956187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:45.956648 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:45.956318 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:46.556371 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:46.555876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:46.556371 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.556108 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:46.556371 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.556181 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:54.556160353 +0000 UTC m=+17.009605257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:46.657335 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:46.657230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:46.657515 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.657371 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:46.657515 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.657442 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:54.657424119 +0000 UTC m=+17.110869040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:46.758033 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:46.757995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:46.758223 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.758193 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:46.758359 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.758231 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:46.758359 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.758246 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:46.758359 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.758317 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:43:54.758294223 +0000 UTC m=+17.211739127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:46.953809 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:46.953731 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:46.953809 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:46.953763 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:46.954047 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.953880 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:46.954047 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:46.954005 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:47.955401 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:47.954969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:47.955401 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:47.955071 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:48.954408 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:48.954376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:48.954579 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:48.954506 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:48.954623 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:48.954571 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:48.954715 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:48.954678 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:49.954410 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:49.954366 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:49.954788 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:49.954498 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:50.953488 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:50.953457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:50.953656 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:50.953496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:50.953656 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:50.953631 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:50.953777 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:50.953738 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:51.953922 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:51.953874 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:51.954396 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:51.954025 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:52.953904 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:52.953866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:52.954082 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:52.953931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:52.954082 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:52.954015 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:52.954492 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:52.954146 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:53.956663 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:53.956629 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:53.957127 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:53.956760 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:54.614156 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:54.614121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:54.614379 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.614268 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:54.614379 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.614326 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:10.614311053 +0000 UTC m=+33.067755956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:54.714486 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:54.714458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:54.714669 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.714591 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:54.714669 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.714652 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:10.714633967 +0000 UTC m=+33.168078870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:54.814958 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:54.814930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:54.815126 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.815107 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:54.815126 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.815124 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:54.815218 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.815134 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:54.815218 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.815187 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:44:10.815168468 +0000 UTC m=+33.268613388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:54.953689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:54.953609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:54.953689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:54.953640 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:54.953867 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.953752 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:54.953905 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:54.953869 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:55.956788 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:55.956760 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:55.957234 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:55.956887 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:56.954403 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:56.954368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:56.954572 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:56.954376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:56.954572 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:56.954518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:56.954700 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:56.954602 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:57.954571 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:57.954541 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:57.954955 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:57.954638 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:58.954084 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:58.953789 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:43:58.954173 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:58.953829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:43:58.954221 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:58.954168 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:43:58.954265 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:58.954241 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:43:59.139429 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"008bb26a10d4dc03af175e0e7daf2353ecb9b251c4aa0320465c2d07ca045fb2"} Jun 03 20:43:59.140272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"0976602bf29e9809aa90523d3cdbacb9cb83f0d231d96880060cf1104ee85a2f"} Jun 03 20:43:59.140272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"b1ce63347388d654bd068984778b060d0adf6c034702da485135189952db80ae"} Jun 03 20:43:59.140272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139583 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"97a67e6d69de325bd630224bbe7e64041d26ac3fde6f5b4dc6d7514d26f020f5"} Jun 03 20:43:59.140272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139632 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"61ab1de3c8f0a4723757cc073db4af6ef20c4a193b646cc4ad2d33fa54ca7d75"} Jun 03 20:43:59.140272 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.139680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"0364983ae10f9238a844adef846c4300a0c2c8e6c009b8f0a0cf4a494e8d38f3"} Jun 03 20:43:59.141034 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.141007 2554 generic.go:356] "Generic (PLEG): container finished" podID="44315d963e4fff058800ef8bf0713ba7" containerID="71618c766355b264b69003aeed3214962035e0ada31c9a45f64e67bbe75bf560" exitCode=0 Jun 03 20:43:59.141137 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.141034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"44315d963e4fff058800ef8bf0713ba7","Type":"ContainerDied","Data":"71618c766355b264b69003aeed3214962035e0ada31c9a45f64e67bbe75bf560"} Jun 03 20:43:59.142855 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.142830 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="d8fd93f0c545ad0f9a1a72c47f65957a5f28c786a83a7e638166447217f4a396" exitCode=0 Jun 03 20:43:59.142985 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.142931 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"d8fd93f0c545ad0f9a1a72c47f65957a5f28c786a83a7e638166447217f4a396"} Jun 03 20:43:59.145631 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.145573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" event={"ID":"95432a1e-1f67-4a78-b754-2cce86e5e153","Type":"ContainerStarted","Data":"a7d2e8df0b6494f2028c5015544945d890b8b0a3eec3bd6503d6726c6f07df4c"} Jun 03 20:43:59.147701 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.147681 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" event={"ID":"e0c53928-22ae-420f-802e-5481b5c282e7","Type":"ContainerStarted","Data":"3ce06e4b625f830224fa4f430ed350c0688e20b2c3c5b292548afb6074822b9e"} Jun 03 20:43:59.149409 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.149382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wszwv" event={"ID":"63fcc97d-00e8-4aaf-a8a6-efeb3ece2ab1","Type":"ContainerStarted","Data":"930fc5e1597b0e00456563c456469fb93593d6f6e66e4c8b83567d67f3d414f9"} Jun 03 20:43:59.151250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.151205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vstwg" event={"ID":"fdbd75ac-7c83-42c6-8d22-95cef227c93e","Type":"ContainerStarted","Data":"a489cafa44350be5d936788ca8e74d8de2f1450333415cd30651f7c9ebe75ceb"} Jun 03 20:43:59.152764 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.152736 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tsbg" event={"ID":"b391488a-1b65-4db1-8e08-dd002ab4544c","Type":"ContainerStarted","Data":"6c02cd1009670686e78445a2ae37194c1339d6f38dd47d87902c708b240c5e62"} Jun 03 20:43:59.154265 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.154245 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" event={"ID":"11f9974b03393a4242e374df7239145d","Type":"ContainerStarted","Data":"551b4445a0634332a10af2a0e51f9c8852a0356ddb623c71f2b5ae446abcb364"} Jun 03 20:43:59.157934 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.157892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgt7r" event={"ID":"73b5fab7-1a3f-4e57-84a3-58d1b7340f23","Type":"ContainerStarted","Data":"f4062271407901017aa6828e12853856ee7364de0376415beeec0aa3e18ca953"} Jun 03 20:43:59.187123 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.187060 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9tsbg" podStartSLOduration=2.158423253 podStartE2EDuration="21.187031271s" totalImagesPullingTime="19.028608018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.169153298 +0000 UTC m=+21.622598235" watchObservedRunningTime="2026-06-03 20:43:59.187031271 +0000 UTC m=+21.640476197" Jun 03 20:43:59.187242 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.187181 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vstwg" podStartSLOduration=2.208520148 podStartE2EDuration="21.187173806s" totalImagesPullingTime="18.978653658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.186377039 +0000 UTC m=+21.639821963" watchObservedRunningTime="2026-06-03 20:43:59.187173806 +0000 UTC m=+21.640618732" Jun 03 20:43:59.204728 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.204682 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rwkgf" podStartSLOduration=2.219112358 podStartE2EDuration="21.204668598s" totalImagesPullingTime="18.98555624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.204133489 +0000 UTC m=+21.657578415" watchObservedRunningTime="2026-06-03 20:43:59.204668598 +0000 UTC m=+21.658113523" Jun 03 20:43:59.238645 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.238568 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" podStartSLOduration=21.238553386 podStartE2EDuration="21.238553386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.238505874 +0000 UTC m=+21.691950800" watchObservedRunningTime="2026-06-03 20:43:59.238553386 +0000 UTC m=+21.691998310" Jun 03 20:43:59.250838 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.250799 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.272649 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.272610 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xgt7r" podStartSLOduration=2.270310735 podStartE2EDuration="21.272594825s" totalImagesPullingTime="19.00228409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.272576069 +0000 UTC m=+21.726020995" watchObservedRunningTime="2026-06-03 20:43:59.272594825 +0000 UTC m=+21.726039752" Jun 03 20:43:59.272776 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.272725 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wszwv" podStartSLOduration=2.266701123 podStartE2EDuration="21.272716274s" totalImagesPullingTime="19.006015151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.258148708 +0000 UTC m=+21.711593634" watchObservedRunningTime="2026-06-03 20:43:59.272716274 +0000 UTC m=+21.726161201" Jun 03 20:43:59.331006 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.330974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.432460 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.432428 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.490740 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.490639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.570680 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.570650 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.670809 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.670780 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.893743 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.893708 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 20:43:59.954144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.954120 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:43:59.954258 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:43:59.954237 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:43:59.955066 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.954988 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T20:43:59.893725753Z","UUID":"bbdbb0be-9353-48d4-bbb5-957acef55202","Handler":null,"Name":"","Endpoint":""} Jun 03 20:43:59.956692 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.956630 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 20:43:59.956692 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:43:59.956680 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 20:44:00.125637 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.125563 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:44:00.126145 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.126126 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:44:00.129351 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.129328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:00.163678 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.163428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptg2q" event={"ID":"67dcc848-e2b1-47dc-b90a-ebed8fd67fd0","Type":"ContainerStarted","Data":"04fbc3da0c57bfb2eba3ac16ad266e9696975904f6bf090e02a19901264d1b23"} Jun 03 20:44:00.165625 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.165595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"44315d963e4fff058800ef8bf0713ba7","Type":"ContainerStarted","Data":"26fbc013d6b1739391c67ebd627a8c7655ea8c686e1e008ff63092d0e35469a5"} Jun 03 20:44:00.167821 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.167795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" event={"ID":"e0c53928-22ae-420f-802e-5481b5c282e7","Type":"ContainerStarted","Data":"1a979628703780faea10677ea332b6817e3b00e8caf02975ef0afd1d4cdd8086"} Jun 03 20:44:00.168603 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.168584 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:44:00.168977 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.168957 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9tsbg" Jun 03 20:44:00.179334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.179293 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ptg2q" podStartSLOduration=3.204937429 podStartE2EDuration="22.179278771s" totalImagesPullingTime="18.974341342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:00.179080374 +0000 UTC m=+22.632525301" watchObservedRunningTime="2026-06-03 20:44:00.179278771 +0000 UTC m=+22.632723695" Jun 03 20:44:00.193094 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.193052 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" podStartSLOduration=22.193036767 podStartE2EDuration="22.193036767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:00.193025993 +0000 UTC m=+22.646470919" watchObservedRunningTime="2026-06-03 20:44:00.193036767 +0000 UTC m=+22.646481695" Jun 03 20:44:00.268844 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.268817 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:00.381674 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.381600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:00.775019 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.774932 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:00.841417 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.841385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:00.953782 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.953757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:00.953922 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:00.953873 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:00.953981 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:00.953938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:00.954051 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:00.954031 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:01.171995 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:01.171965 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" event={"ID":"e0c53928-22ae-420f-802e-5481b5c282e7","Type":"ContainerStarted","Data":"9f284796d05d762e3dc6e39e3ac9e72e7657bf1c8eda86ff8a4657b96da566c7"} Jun 03 20:44:01.189668 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:01.189617 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt9b7" podStartSLOduration=2.230146311 podStartE2EDuration="23.189597431s" totalImagesPullingTime="20.95945112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:01.189264898 +0000 UTC m=+23.642709824" watchObservedRunningTime="2026-06-03 20:44:01.189597431 +0000 UTC m=+23.643042354" Jun 03 20:44:01.954327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:01.954290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:01.954484 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:01.954291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:01.954484 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:01.954428 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:01.954603 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:01.954508 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:02.177427 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:02.177237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"e5421657d4eff722638567568b1080608f095934ce0d7cf188a044b1ba0dd24a"} Jun 03 20:44:02.954225 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:02.954194 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:02.954411 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:02.954324 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:03.954485 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:03.954263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:03.955166 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:03.954328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:03.955166 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:03.954499 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:03.955166 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:03.954578 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:04.183491 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.183456 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="c45d36dde0d5551cf9580af530308ccd381290a9e7d08fe5a185c6d4bcce8240" exitCode=0 Jun 03 20:44:04.183643 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.183544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"c45d36dde0d5551cf9580af530308ccd381290a9e7d08fe5a185c6d4bcce8240"} Jun 03 20:44:04.187147 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.187127 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" event={"ID":"a1f6a021-3de1-4341-838f-95b5b3235256","Type":"ContainerStarted","Data":"4e78cf0c69b7efd48b4372482659f0dcf183b6cffa5f6700c4bd2701f871b3db"} Jun 03 20:44:04.187400 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.187379 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:04.187460 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.187437 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:04.202489 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.202472 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:04.233537 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.233470 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" podStartSLOduration=7.014111598 podStartE2EDuration="26.233456969s" totalImagesPullingTime="19.219345371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:04.232777026 +0000 UTC m=+26.686221951" watchObservedRunningTime="2026-06-03 20:44:04.233456969 +0000 UTC m=+26.686901893" Jun 03 20:44:04.953438 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:04.953408 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:04.953662 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:04.953534 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:05.193765 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.193730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:05.218697 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.218290 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:05.382380 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.382350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwx84"] Jun 03 20:44:05.382539 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.382459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:05.382587 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:05.382554 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:05.383024 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.383003 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jwdsl"] Jun 03 20:44:05.383224 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.383089 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:05.383224 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:05.383173 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:05.383646 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.383624 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x5c7b"] Jun 03 20:44:05.383746 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:05.383721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:05.383839 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:05.383821 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:06.193929 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:06.193880 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="6a61d46863f07d5036b632f9f8cb4c29aeede4c823a86b016b1a4b749102209d" exitCode=0 Jun 03 20:44:06.194304 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:06.193959 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"6a61d46863f07d5036b632f9f8cb4c29aeede4c823a86b016b1a4b749102209d"} Jun 03 20:44:06.954453 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:06.954290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:06.954605 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:06.954350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:06.954605 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:06.954520 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:06.954701 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:06.954620 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:06.954701 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:06.954350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:06.954777 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:06.954733 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:08.199722 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:08.199690 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="4ec6eda2e3ac07031fdba76c50e4b66a7060bb399f1e77eb3647a0937fa250b3" exitCode=0 Jun 03 20:44:08.200232 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:08.199736 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"4ec6eda2e3ac07031fdba76c50e4b66a7060bb399f1e77eb3647a0937fa250b3"} Jun 03 20:44:08.953391 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:08.953360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:08.953569 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:08.953360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:08.953569 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:08.953492 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:08.953569 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:08.953360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:08.953700 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:08.953568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:08.953700 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:08.953636 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:09.864956 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:09.864902 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:09.994553 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:09.994518 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:10.632803 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.632767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:10.632991 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.632909 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:44:10.632991 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.632980 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret podName:ff4710bf-8cde-4917-8db9-29e35c12d574 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:42.632962421 +0000 UTC m=+65.086407326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret") pod "global-pull-secret-syncer-jwdsl" (UID: "ff4710bf-8cde-4917-8db9-29e35c12d574") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:44:10.733235 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.733201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:10.733416 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.733365 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:44:10.733475 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.733440 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:42.733417572 +0000 UTC m=+65.186862498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:44:10.833625 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.833592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:10.833800 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.833723 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:44:10.833800 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.833742 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:44:10.833800 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.833753 2554 projected.go:196] Error preparing data for projected volume kube-api-access-l92c8 for pod openshift-network-diagnostics/network-check-target-jwx84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:44:10.833984 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.833804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8 podName:664e1818-e725-44c7-9c79-ff1f2cf15ded nodeName:}" failed. No retries permitted until 2026-06-03 20:44:42.833788486 +0000 UTC m=+65.287233407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l92c8" (UniqueName: "kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8") pod "network-check-target-jwx84" (UID: "664e1818-e725-44c7-9c79-ff1f2cf15ded") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:44:10.954042 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.953958 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:10.954042 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.953991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:10.954042 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:10.953991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:10.954519 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.954072 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jwdsl" podUID="ff4710bf-8cde-4917-8db9-29e35c12d574" Jun 03 20:44:10.954519 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.954167 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwx84" podUID="664e1818-e725-44c7-9c79-ff1f2cf15ded" Jun 03 20:44:10.954519 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:10.954253 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:44:12.212118 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.212089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerStarted","Data":"b729c0b8d6e1adebb7528c8c7b89d4e8e860d8ebbc8ead860127e92a566d8300"} Jun 03 20:44:12.357500 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.357474 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeReady" Jun 03 20:44:12.357624 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.357585 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 20:44:12.417780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.417700 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nrr98"] Jun 03 20:44:12.419466 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.419450 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2kwnw"] Jun 03 20:44:12.419589 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.419573 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.421096 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.421078 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.423225 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423207 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 20:44:12.423328 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:44:12.423328 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423259 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 20:44:12.423328 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423293 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ql74z\"" Jun 03 20:44:12.423591 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423575 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 20:44:12.423662 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 20:44:12.423982 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.423967 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 20:44:12.437589 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.437543 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrr98"] Jun 03 20:44:12.438142 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.438127 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2kwnw"] Jun 03 20:44:12.546330 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.546506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg6tp\" (UniqueName: \"kubernetes.io/projected/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-kube-api-access-dg6tp\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.546506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-cert\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.546506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-tmp-dir\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.546506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-config-volume\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.546506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.546460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bg62\" (UniqueName: \"kubernetes.io/projected/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-kube-api-access-8bg62\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.552108 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.552085 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:12.647306 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-config-volume\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.647306 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bg62\" (UniqueName: \"kubernetes.io/projected/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-kube-api-access-8bg62\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.647546 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.647546 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg6tp\" (UniqueName: \"kubernetes.io/projected/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-kube-api-access-dg6tp\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.647546 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-cert\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.647546 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-tmp-dir\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.647546 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:12.647503 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:12.647776 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:12.647584 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:13.147563745 +0000 UTC m=+35.601008649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:12.647776 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647742 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-tmp-dir\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.648004 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.647987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-config-volume\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.651495 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.651356 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-cert\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.652681 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.652660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:12.657800 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.657780 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg6tp\" (UniqueName: \"kubernetes.io/projected/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-kube-api-access-dg6tp\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:12.657970 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.657956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bg62\" (UniqueName: \"kubernetes.io/projected/9998b060-f5ec-4918-a2d9-7cefc8cd4d3f-kube-api-access-8bg62\") pod \"ingress-canary-nrr98\" (UID: \"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f\") " pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.729955 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.729877 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrr98" Jun 03 20:44:12.856219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.856189 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrr98"] Jun 03 20:44:12.860227 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:44:12.860197 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9998b060_f5ec_4918_a2d9_7cefc8cd4d3f.slice/crio-a304e30b75f460b114d5880edb9c35c58d619de4f122146e1e13a30c43774041 WatchSource:0}: Error finding container a304e30b75f460b114d5880edb9c35c58d619de4f122146e1e13a30c43774041: Status 404 returned error can't find the container with id a304e30b75f460b114d5880edb9c35c58d619de4f122146e1e13a30c43774041 Jun 03 20:44:12.954349 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.954322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:12.954462 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.954428 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:12.954526 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.954322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:12.956584 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956565 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:44:12.956584 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956578 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:44:12.956790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956777 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:44:12.956872 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956778 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:44:12.956872 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956830 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:44:12.957077 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:12.956906 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:44:13.152642 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:13.152614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:13.152779 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:13.152761 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:13.152837 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:13.152828 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:14.152809718 +0000 UTC m=+36.606254621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:13.217566 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:13.217533 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="b729c0b8d6e1adebb7528c8c7b89d4e8e860d8ebbc8ead860127e92a566d8300" exitCode=0 Jun 03 20:44:13.218186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:13.217623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"b729c0b8d6e1adebb7528c8c7b89d4e8e860d8ebbc8ead860127e92a566d8300"} Jun 03 20:44:13.219007 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:13.218974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrr98" event={"ID":"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f","Type":"ContainerStarted","Data":"a304e30b75f460b114d5880edb9c35c58d619de4f122146e1e13a30c43774041"} Jun 03 20:44:14.161294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:14.161247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:14.161472 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:14.161416 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:14.161548 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:14.161494 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:16.161474351 +0000 UTC m=+38.614919255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:14.225095 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:14.225061 2554 generic.go:356] "Generic (PLEG): container finished" podID="e915fdfd-d1f6-467b-96ec-411a671ef8de" containerID="e5f99d5c82d185cece490d75bc698f2bf56264550d0c83ede30a5bfe60847e66" exitCode=0 Jun 03 20:44:14.225439 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:14.225129 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerDied","Data":"e5f99d5c82d185cece490d75bc698f2bf56264550d0c83ede30a5bfe60847e66"} Jun 03 20:44:14.250743 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:14.250513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:14.303878 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:14.303827 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:15.228638 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.228557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrr98" event={"ID":"9998b060-f5ec-4918-a2d9-7cefc8cd4d3f","Type":"ContainerStarted","Data":"41c1f95ff06c06d910c4e8aef54258e1a12edc3098cafaccf55ab7909a0a71a5"} Jun 03 20:44:15.231937 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.231899 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" event={"ID":"e915fdfd-d1f6-467b-96ec-411a671ef8de","Type":"ContainerStarted","Data":"d7dd0d26c5a1123ed8165ac36cffec83672478ca241fc6c64d5f3c7f75d5d3d2"} Jun 03 20:44:15.232696 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.232669 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:15.244566 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.244486 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nrr98" podStartSLOduration=1.755333275 podStartE2EDuration="3.244470317s" totalImagesPullingTime="1.489137042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:15.244174852 +0000 UTC m=+37.697619778" watchObservedRunningTime="2026-06-03 20:44:15.244470317 +0000 UTC m=+37.697915235" Jun 03 20:44:15.265322 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.265286 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tt7d7" podStartSLOduration=8.02174787 podStartE2EDuration="37.265273526s" totalImagesPullingTime="29.243525656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:15.264215766 +0000 UTC m=+37.717660691" watchObservedRunningTime="2026-06-03 20:44:15.265273526 +0000 UTC m=+37.718718461" Jun 03 20:44:15.333580 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.333549 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:15.434630 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.434593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:15.534657 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:15.534585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:16.175468 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:16.175422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:16.175629 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:16.175580 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:16.175696 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:16.175645 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:20.175629334 +0000 UTC m=+42.629074238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:19.271108 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:19.271065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:19.337436 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:19.337401 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:20.202236 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:20.202199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:20.202407 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:20.202317 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:20.202407 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:20.202366 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:28.202353852 +0000 UTC m=+50.655798754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:28.256962 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:28.256929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:28.257396 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:28.257048 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:28.257396 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:28.257098 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:44.257084372 +0000 UTC m=+66.710529275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:29.650299 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.650267 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl"] Jun 03 20:44:29.668292 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.668257 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb"] Jun 03 20:44:29.668445 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.668392 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.670776 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.670755 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 20:44:29.670932 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.670764 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 20:44:29.670932 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.670755 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 20:44:29.670932 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.670786 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 20:44:29.670932 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.670755 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vh2pf\"" Jun 03 20:44:29.682865 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.682843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl"] Jun 03 20:44:29.682995 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.682875 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb"] Jun 03 20:44:29.683042 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.683018 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.684849 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.684829 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 20:44:29.684849 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.684849 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 20:44:29.685030 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.684893 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 20:44:29.685030 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.685016 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 20:44:29.766305 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.766279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwld\" (UniqueName: \"kubernetes.io/projected/0943625d-4cea-435e-97c3-db1f5b7e15b4-kube-api-access-krwld\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.766401 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.766343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0943625d-4cea-435e-97c3-db1f5b7e15b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.867070 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0943625d-4cea-435e-97c3-db1f5b7e15b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.867202 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.867202 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.867202 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7109d7-52e2-412a-8df4-f7ea607a289f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.867335 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krwld\" (UniqueName: \"kubernetes.io/projected/0943625d-4cea-435e-97c3-db1f5b7e15b4-kube-api-access-krwld\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.867335 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.867335 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.867429 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.867343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhxc\" (UniqueName: \"kubernetes.io/projected/ef7109d7-52e2-412a-8df4-f7ea607a289f-kube-api-access-xqhxc\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.870854 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.870837 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0943625d-4cea-435e-97c3-db1f5b7e15b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.875312 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.875293 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwld\" (UniqueName: \"kubernetes.io/projected/0943625d-4cea-435e-97c3-db1f5b7e15b4-kube-api-access-krwld\") pod \"managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl\" (UID: \"0943625d-4cea-435e-97c3-db1f5b7e15b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.968689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.968689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.968862 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhxc\" (UniqueName: \"kubernetes.io/projected/ef7109d7-52e2-412a-8df4-f7ea607a289f-kube-api-access-xqhxc\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.968862 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.969012 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.969012 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.968905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7109d7-52e2-412a-8df4-f7ea607a289f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.969625 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.969599 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7109d7-52e2-412a-8df4-f7ea607a289f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.971135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.971100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.971236 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.971155 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-ca\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.971236 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.971183 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.971321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.971303 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ef7109d7-52e2-412a-8df4-f7ea607a289f-hub\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.976764 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.976742 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhxc\" (UniqueName: \"kubernetes.io/projected/ef7109d7-52e2-412a-8df4-f7ea607a289f-kube-api-access-xqhxc\") pod \"cluster-proxy-proxy-agent-74f4d4464f-tclqb\" (UID: \"ef7109d7-52e2-412a-8df4-f7ea607a289f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:29.984591 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.984574 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" Jun 03 20:44:29.990724 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:29.990708 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:44:30.142220 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:30.142189 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl"] Jun 03 20:44:30.145072 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:44:30.145042 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0943625d_4cea_435e_97c3_db1f5b7e15b4.slice/crio-6125f4dc88f96adde5d6e45d2e49e5f046d5cb4ac9bf761d2dbb06c84be8113c WatchSource:0}: Error finding container 6125f4dc88f96adde5d6e45d2e49e5f046d5cb4ac9bf761d2dbb06c84be8113c: Status 404 returned error can't find the container with id 6125f4dc88f96adde5d6e45d2e49e5f046d5cb4ac9bf761d2dbb06c84be8113c Jun 03 20:44:30.158037 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:30.158015 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb"] Jun 03 20:44:30.160845 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:44:30.160824 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef7109d7_52e2_412a_8df4_f7ea607a289f.slice/crio-b5515f6176c04fa6843dc0634148894182b81824f97014ef66e5d88c3f36aab2 WatchSource:0}: Error finding container b5515f6176c04fa6843dc0634148894182b81824f97014ef66e5d88c3f36aab2: Status 404 returned error can't find the container with id b5515f6176c04fa6843dc0634148894182b81824f97014ef66e5d88c3f36aab2 Jun 03 20:44:30.265812 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:30.265737 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerStarted","Data":"b5515f6176c04fa6843dc0634148894182b81824f97014ef66e5d88c3f36aab2"} Jun 03 20:44:30.266741 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:30.266719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" event={"ID":"0943625d-4cea-435e-97c3-db1f5b7e15b4","Type":"ContainerStarted","Data":"6125f4dc88f96adde5d6e45d2e49e5f046d5cb4ac9bf761d2dbb06c84be8113c"} Jun 03 20:44:35.283177 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.283139 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerStarted","Data":"8ca960cae734db70078ffec4036964f59e68aa6e0eaf8e87fe4c1dd25786f7b5"} Jun 03 20:44:35.283624 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.283188 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerStarted","Data":"f363c0e21288273452e6af372724c3f72e54fca031453d194fcebd2bf16a41df"} Jun 03 20:44:35.283624 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.283205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerStarted","Data":"2ebe9a99e6a1bbb4b57aa34065a4604ae5b67d7c442fd4e2eebd871428205480"} Jun 03 20:44:35.284566 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.284540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" event={"ID":"0943625d-4cea-435e-97c3-db1f5b7e15b4","Type":"ContainerStarted","Data":"442a261b5f19de7d105a04e029c6cb702d99b54a26d3823486e07f80b3ef76af"} Jun 03 20:44:35.300761 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.300720 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" podStartSLOduration=1.666771765 podStartE2EDuration="6.300705098s" totalImagesPullingTime="4.633933333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:35.300293895 +0000 UTC m=+57.753738820" watchObservedRunningTime="2026-06-03 20:44:35.300705098 +0000 UTC m=+57.754150002" Jun 03 20:44:35.313152 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:35.313106 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" podStartSLOduration=1.703583215 podStartE2EDuration="6.313092311s" totalImagesPullingTime="4.609509096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:35.312975509 +0000 UTC m=+57.766420433" watchObservedRunningTime="2026-06-03 20:44:35.313092311 +0000 UTC m=+57.766537237" Jun 03 20:44:36.230334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:36.230300 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:36.282837 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:36.282804 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:37.215845 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:37.215816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgsj5" Jun 03 20:44:37.330331 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:37.330300 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:37.430374 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:37.430344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:37.496380 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:37.496326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:44:42.655376 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.655339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:42.657794 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.657774 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:44:42.668446 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.668421 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff4710bf-8cde-4917-8db9-29e35c12d574-original-pull-secret\") pod \"global-pull-secret-syncer-jwdsl\" (UID: \"ff4710bf-8cde-4917-8db9-29e35c12d574\") " pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:42.670378 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.670357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jwdsl" Jun 03 20:44:42.756604 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.756569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:44:42.758757 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.758738 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:44:42.767124 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:42.767103 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:44:42.767213 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:42.767162 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:46.767145353 +0000 UTC m=+129.220590259 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : secret "metrics-daemon-secret" not found Jun 03 20:44:42.789945 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.789900 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jwdsl"] Jun 03 20:44:42.794326 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:44:42.794292 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4710bf_8cde_4917_8db9_29e35c12d574.slice/crio-4657dce18523834330874670b5608ddcd5446f9618b8678442440fd00f9280a5 WatchSource:0}: Error finding container 4657dce18523834330874670b5608ddcd5446f9618b8678442440fd00f9280a5: Status 404 returned error can't find the container with id 4657dce18523834330874670b5608ddcd5446f9618b8678442440fd00f9280a5 Jun 03 20:44:42.857393 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.857364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:42.859640 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.859619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:44:42.870134 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.870110 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:44:42.880801 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.880778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l92c8\" (UniqueName: \"kubernetes.io/projected/664e1818-e725-44c7-9c79-ff1f2cf15ded-kube-api-access-l92c8\") pod \"network-check-target-jwx84\" (UID: \"664e1818-e725-44c7-9c79-ff1f2cf15ded\") " pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:42.966424 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.966368 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:44:42.974851 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:42.974833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:43.100327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:43.100295 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwx84"] Jun 03 20:44:43.104450 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:44:43.104421 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664e1818_e725_44c7_9c79_ff1f2cf15ded.slice/crio-0a54c851d49fc0cf54727e337e427ff6bade043d40411f0b4d2ac59afe342a7f WatchSource:0}: Error finding container 0a54c851d49fc0cf54727e337e427ff6bade043d40411f0b4d2ac59afe342a7f: Status 404 returned error can't find the container with id 0a54c851d49fc0cf54727e337e427ff6bade043d40411f0b4d2ac59afe342a7f Jun 03 20:44:43.302972 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:43.302939 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwx84" event={"ID":"664e1818-e725-44c7-9c79-ff1f2cf15ded","Type":"ContainerStarted","Data":"0a54c851d49fc0cf54727e337e427ff6bade043d40411f0b4d2ac59afe342a7f"} Jun 03 20:44:43.303983 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:43.303962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jwdsl" event={"ID":"ff4710bf-8cde-4917-8db9-29e35c12d574","Type":"ContainerStarted","Data":"4657dce18523834330874670b5608ddcd5446f9618b8678442440fd00f9280a5"} Jun 03 20:44:44.266975 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:44.266854 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:44:44.267439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:44.267035 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:44.267439 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:44:44.267121 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:16.267098143 +0000 UTC m=+98.720543057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:44:48.320054 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:48.320019 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jwdsl" event={"ID":"ff4710bf-8cde-4917-8db9-29e35c12d574","Type":"ContainerStarted","Data":"f3d5eafe93282386b3d439a8f141e71d1b6cad8cc1a64c4c791a162dc612843d"} Jun 03 20:44:48.321298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:48.321271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwx84" event={"ID":"664e1818-e725-44c7-9c79-ff1f2cf15ded","Type":"ContainerStarted","Data":"8c33413a0942b9c8333408a6a06bf88ed7787b2398521c2e1f69fd702d6afeb3"} Jun 03 20:44:48.321416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:48.321398 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:44:48.334778 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:48.334732 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jwdsl" podStartSLOduration=65.637162545 podStartE2EDuration="1m10.334716374s" totalImagesPullingTime="4.697553829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:48.334249564 +0000 UTC m=+70.787694489" watchObservedRunningTime="2026-06-03 20:44:48.334716374 +0000 UTC m=+70.788161300" Jun 03 20:44:48.348653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:44:48.348611 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jwx84" podStartSLOduration=65.966699669 podStartE2EDuration="1m10.348597659s" totalImagesPullingTime="4.38189799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:48.347647853 +0000 UTC m=+70.801092778" watchObservedRunningTime="2026-06-03 20:44:48.348597659 +0000 UTC m=+70.802042583" Jun 03 20:45:16.276061 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:45:16.276017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:45:16.276568 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:45:16.276145 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:45:16.276568 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:45:16.276228 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:20.27620832 +0000 UTC m=+162.729653229 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:45:19.326232 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:45:19.326203 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jwx84" Jun 03 20:45:46.773357 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:45:46.773314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:45:46.773965 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:45:46.773450 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:45:46.773965 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:45:46.773540 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs podName:811b3128-3350-4fa9-bac8-c63ffe694983 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:48.773519237 +0000 UTC m=+251.226964161 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs") pod "network-metrics-daemon-x5c7b" (UID: "811b3128-3350-4fa9-bac8-c63ffe694983") : secret "metrics-daemon-secret" not found Jun 03 20:46:15.434266 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:46:15.434225 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2kwnw" podUID="5fd35282-301b-4a08-b1ad-b3ccd9abbdb3" Jun 03 20:46:15.566821 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:15.566794 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:46:15.974090 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:46:15.974051 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x5c7b" podUID="811b3128-3350-4fa9-bac8-c63ffe694983" Jun 03 20:46:19.707867 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:19.707838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:20.299481 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:20.299435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:46:20.299667 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:46:20.299595 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:46:20.299717 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:46:20.299675 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls podName:5fd35282-301b-4a08-b1ad-b3ccd9abbdb3 nodeName:}" failed. No retries permitted until 2026-06-03 20:48:22.299656895 +0000 UTC m=+284.753101798 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls") pod "dns-default-2kwnw" (UID: "5fd35282-301b-4a08-b1ad-b3ccd9abbdb3") : secret "dns-default-metrics-tls" not found Jun 03 20:46:26.953910 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:26.953875 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:46:35.623305 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:35.623264 2554 generic.go:356] "Generic (PLEG): container finished" podID="0943625d-4cea-435e-97c3-db1f5b7e15b4" containerID="442a261b5f19de7d105a04e029c6cb702d99b54a26d3823486e07f80b3ef76af" exitCode=255 Jun 03 20:46:35.623673 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:35.623336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" event={"ID":"0943625d-4cea-435e-97c3-db1f5b7e15b4","Type":"ContainerDied","Data":"442a261b5f19de7d105a04e029c6cb702d99b54a26d3823486e07f80b3ef76af"} Jun 03 20:46:35.623673 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:35.623626 2554 scope.go:117] "RemoveContainer" containerID="442a261b5f19de7d105a04e029c6cb702d99b54a26d3823486e07f80b3ef76af" Jun 03 20:46:36.627264 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:36.627233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbb4fc684-bl4fl" event={"ID":"0943625d-4cea-435e-97c3-db1f5b7e15b4","Type":"ContainerStarted","Data":"1df5617ca75335e7c2bfe9b0557c20eef4c93ff58043bc7b0519afda148f5922"} Jun 03 20:46:47.611498 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:47.611465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:47.711425 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:47.711393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.657768 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:49.657736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.706304 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:49.706268 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.440370 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.440338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.510413 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.510378 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.640747 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.640721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.733151 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.733052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.831274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.831250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.887276 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:51.887251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:52.296929 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:52.296890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:52.401273 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:52.401234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.681137 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:53.681103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.735787 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:53.735758 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.000003 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:53.999908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.050641 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:54.050613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.543826 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:54.543798 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vstwg_fdbd75ac-7c83-42c6-8d22-95cef227c93e/dns-node-resolver/0.log" Jun 03 20:46:54.773834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:54.773806 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:55.544548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:55.544523 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xgt7r_73b5fab7-1a3f-4e57-84a3-58d1b7340f23/node-ca/0.log" Jun 03 20:46:55.796947 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:55.796845 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:55.990189 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:55.990158 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.191297 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.191263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.343634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.343607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrr98_9998b060-f5ec-4918-a2d9-7cefc8cd4d3f/serve-healthcheck-canary/0.log" Jun 03 20:46:56.365863 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.365839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.469300 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.469222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.568987 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.568956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.863672 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.863640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.917372 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:56.917346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:57.659476 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:57.659444 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:58.257678 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:58.257651 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:58.467843 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:58.467799 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:58.658513 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:58.658480 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.053987 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:59.053958 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.665406 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:59.665376 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.765835 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:46:59.765794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.262325 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:00.262295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.457214 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:00.457184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.854726 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:00.854696 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:01.058735 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:01.058703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:01.508179 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:01.508143 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:01.659378 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:01.659338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:02.162070 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:02.162036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:02.261351 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:02.261307 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:02.464871 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:02.464785 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:02.857383 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:02.857349 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:03.058076 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:03.058045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:03.460252 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:03.460214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:04.055327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:04.055297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:04.456666 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:04.456581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:04.561840 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:04.561803 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:04.853610 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:04.853571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:05.062992 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:05.062961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:05.257257 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:05.257170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.027560 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.027519 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.129417 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.129389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.227794 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.227770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.279416 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.279329 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.459630 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.459602 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.864909 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:06.864875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:09.991765 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:09.991714 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" podUID="ef7109d7-52e2-412a-8df4-f7ea607a289f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:10.356225 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:10.356193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:10.457761 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:10.457732 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:10.557756 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:10.557728 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:10.658347 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:10.658282 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:10.846690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:10.846662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:11.033894 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:11.033821 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:11.240811 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:11.240782 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:11.302313 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:11.302291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:12.048455 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:12.048416 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:12.244502 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:12.244471 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:12.481466 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:12.481392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:12.533224 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:12.533171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:12.989463 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:12.989430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:13.089692 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:13.089662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:13.189517 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:13.189489 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:16.204731 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.204702 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rjdjb"] Jun 03 20:47:16.206662 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.206646 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.211321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.210377 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtnl\"" Jun 03 20:47:16.211321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.210694 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 20:47:16.211321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.210889 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 20:47:16.211321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.211048 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 20:47:16.211632 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.211610 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 20:47:16.223611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.223590 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjdjb"] Jun 03 20:47:16.257321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.257288 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6964d49d65-g7zcb"] Jun 03 20:47:16.258815 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.258792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.260893 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.260870 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 20:47:16.261081 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.260945 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 20:47:16.261164 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.261151 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qqw74\"" Jun 03 20:47:16.261328 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.261316 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 20:47:16.267323 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.267302 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 20:47:16.279462 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.279442 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6964d49d65-g7zcb"] Jun 03 20:47:16.287296 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.287276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b83167-25be-4b9a-a9dc-e935e1507441-crio-socket\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.287407 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.287342 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b83167-25be-4b9a-a9dc-e935e1507441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.287407 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.287395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b83167-25be-4b9a-a9dc-e935e1507441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.287516 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.287430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgds7\" (UniqueName: \"kubernetes.io/projected/11b83167-25be-4b9a-a9dc-e935e1507441-kube-api-access-vgds7\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.287516 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.287468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b83167-25be-4b9a-a9dc-e935e1507441-data-volume\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.320695 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.320668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:16.388585 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-trusted-ca\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.388696 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b83167-25be-4b9a-a9dc-e935e1507441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.388696 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-bound-sa-token\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-image-registry-private-configuration\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgds7\" (UniqueName: \"kubernetes.io/projected/11b83167-25be-4b9a-a9dc-e935e1507441-kube-api-access-vgds7\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-tls\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388764 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-certificates\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-installation-pull-secrets\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgh52\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-kube-api-access-wgh52\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b83167-25be-4b9a-a9dc-e935e1507441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b83167-25be-4b9a-a9dc-e935e1507441-data-volume\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b83167-25be-4b9a-a9dc-e935e1507441-crio-socket\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.388940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd7d499e-5b34-4dea-82d8-07ce00358b76-ca-trust-extracted\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.389039 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.389011 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b83167-25be-4b9a-a9dc-e935e1507441-crio-socket\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.389235 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.389199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b83167-25be-4b9a-a9dc-e935e1507441-data-volume\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.389410 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.389394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b83167-25be-4b9a-a9dc-e935e1507441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.390940 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.390908 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b83167-25be-4b9a-a9dc-e935e1507441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.396474 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.396456 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgds7\" (UniqueName: \"kubernetes.io/projected/11b83167-25be-4b9a-a9dc-e935e1507441-kube-api-access-vgds7\") pod \"insights-runtime-extractor-rjdjb\" (UID: \"11b83167-25be-4b9a-a9dc-e935e1507441\") " pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.421828 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.421805 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:16.489448 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd7d499e-5b34-4dea-82d8-07ce00358b76-ca-trust-extracted\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489448 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-trusted-ca\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-bound-sa-token\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-image-registry-private-configuration\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489597 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-tls\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489771 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-certificates\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489771 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-installation-pull-secrets\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489771 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgh52\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-kube-api-access-wgh52\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.489771 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.489721 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd7d499e-5b34-4dea-82d8-07ce00358b76-ca-trust-extracted\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.490367 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.490339 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-trusted-ca\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.490472 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.490431 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-certificates\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.491931 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.491900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-image-registry-private-configuration\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.492013 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.491972 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-registry-tls\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.492146 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.492130 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd7d499e-5b34-4dea-82d8-07ce00358b76-installation-pull-secrets\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.496989 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.496970 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-bound-sa-token\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.497182 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.497158 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgh52\" (UniqueName: \"kubernetes.io/projected/cd7d499e-5b34-4dea-82d8-07ce00358b76-kube-api-access-wgh52\") pod \"image-registry-6964d49d65-g7zcb\" (UID: \"cd7d499e-5b34-4dea-82d8-07ce00358b76\") " pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.517879 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.517858 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjdjb" Jun 03 20:47:16.567661 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.567638 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:16.638293 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.638262 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjdjb"] Jun 03 20:47:16.642382 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:47:16.642355 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b83167_25be_4b9a_a9dc_e935e1507441.slice/crio-6d5700c170269bf2d7a573d28a0ede3a936b9feb936018facffb82ab65253e31 WatchSource:0}: Error finding container 6d5700c170269bf2d7a573d28a0ede3a936b9feb936018facffb82ab65253e31: Status 404 returned error can't find the container with id 6d5700c170269bf2d7a573d28a0ede3a936b9feb936018facffb82ab65253e31 Jun 03 20:47:16.696284 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.696256 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6964d49d65-g7zcb"] Jun 03 20:47:16.699378 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:47:16.699354 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7d499e_5b34_4dea_82d8_07ce00358b76.slice/crio-e425020ef8d450a2ad0ba8b024d84aeb00c97d29aa208314a964d22376f86b58 WatchSource:0}: Error finding container e425020ef8d450a2ad0ba8b024d84aeb00c97d29aa208314a964d22376f86b58: Status 404 returned error can't find the container with id e425020ef8d450a2ad0ba8b024d84aeb00c97d29aa208314a964d22376f86b58 Jun 03 20:47:16.743012 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.742983 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjdjb" event={"ID":"11b83167-25be-4b9a-a9dc-e935e1507441","Type":"ContainerStarted","Data":"0815d2b22bb3afd91fd051851461872af2c46d64666a4ea500b048092f7d499d"} Jun 03 20:47:16.743126 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.743040 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjdjb" event={"ID":"11b83167-25be-4b9a-a9dc-e935e1507441","Type":"ContainerStarted","Data":"6d5700c170269bf2d7a573d28a0ede3a936b9feb936018facffb82ab65253e31"} Jun 03 20:47:16.744395 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:16.744370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" event={"ID":"cd7d499e-5b34-4dea-82d8-07ce00358b76","Type":"ContainerStarted","Data":"e425020ef8d450a2ad0ba8b024d84aeb00c97d29aa208314a964d22376f86b58"} Jun 03 20:47:17.749653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:17.749615 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjdjb" event={"ID":"11b83167-25be-4b9a-a9dc-e935e1507441","Type":"ContainerStarted","Data":"e374eeeadcc0ca8c4a58bc6f881dba7863966cd25354d4c3bdb806c74bedcc72"} Jun 03 20:47:17.751139 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:17.751106 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" event={"ID":"cd7d499e-5b34-4dea-82d8-07ce00358b76","Type":"ContainerStarted","Data":"a87212c5787fffd2013715357f65dabb825b127e43a0b1a9daf0f9ca01a643f7"} Jun 03 20:47:17.751274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:17.751240 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:17.769288 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:17.769244 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podStartSLOduration=1.769228079 podStartE2EDuration="1.769228079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:17.768293138 +0000 UTC m=+220.221738064" watchObservedRunningTime="2026-06-03 20:47:17.769228079 +0000 UTC m=+220.222673050" Jun 03 20:47:18.756274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:18.756178 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjdjb" event={"ID":"11b83167-25be-4b9a-a9dc-e935e1507441","Type":"ContainerStarted","Data":"ee909f4d662f78e192cef79aa88a748edc43de7420bdcb1d13a1671bce24372a"} Jun 03 20:47:18.771883 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:18.771834 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rjdjb" podStartSLOduration=1.04289327 podStartE2EDuration="2.771820575s" totalImagesPullingTime="1.728927305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:18.770885982 +0000 UTC m=+221.224330906" watchObservedRunningTime="2026-06-03 20:47:18.771820575 +0000 UTC m=+221.225265499" Jun 03 20:47:19.223461 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:19.223425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:19.316923 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:19.316881 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:19.377118 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:19.377083 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:19.992509 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:19.992474 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" podUID="ef7109d7-52e2-412a-8df4-f7ea607a289f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:21.191642 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:21.191613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:21.241151 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:21.241124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:21.805192 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:21.805163 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:21.905998 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:21.905971 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.350265 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.350234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.504947 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.504902 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.580481 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.580441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.622955 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.622868 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnwxg"] Jun 03 20:47:23.625173 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.625157 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.626908 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.626887 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 20:47:23.627094 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627081 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 20:47:23.627146 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627094 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5g8v\"" Jun 03 20:47:23.627364 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 20:47:23.627457 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627420 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 20:47:23.627515 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627457 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 20:47:23.627515 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.627457 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 20:47:23.694613 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.694583 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.748948 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.748903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-metrics-client-ca\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749073 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.748955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749073 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-root\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749073 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-wtmp\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749181 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749181 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tfw\" (UniqueName: \"kubernetes.io/projected/535f4c50-c0c0-4de7-a442-655b5d676392-kube-api-access-77tfw\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749181 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-tls\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-textfile\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.749298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.749212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-sys\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.794526 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.794482 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.849889 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.849865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-textfile\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850044 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.849894 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-sys\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850044 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.849936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-metrics-client-ca\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850044 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.849961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850044 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850003 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-root\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850044 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-wtmp\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850004 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-sys\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850091 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-root\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tfw\" (UniqueName: \"kubernetes.io/projected/535f4c50-c0c0-4de7-a442-655b5d676392-kube-api-access-77tfw\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-tls\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850178 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-wtmp\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850294 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850292 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-textfile\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850591 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850567 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.850738 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.850724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535f4c50-c0c0-4de7-a442-655b5d676392-metrics-client-ca\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.852388 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.852371 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.852462 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.852394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/535f4c50-c0c0-4de7-a442-655b5d676392-node-exporter-tls\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.859365 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.859340 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tfw\" (UniqueName: \"kubernetes.io/projected/535f4c50-c0c0-4de7-a442-655b5d676392-kube-api-access-77tfw\") pod \"node-exporter-fnwxg\" (UID: \"535f4c50-c0c0-4de7-a442-655b5d676392\") " pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.903421 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.903357 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.934337 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.934308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnwxg" Jun 03 20:47:23.943222 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:47:23.943199 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535f4c50_c0c0_4de7_a442_655b5d676392.slice/crio-30a5d41244b611b23a51023533c9bb2bf9d52191d36e756e29d1a54caca59488 WatchSource:0}: Error finding container 30a5d41244b611b23a51023533c9bb2bf9d52191d36e756e29d1a54caca59488: Status 404 returned error can't find the container with id 30a5d41244b611b23a51023533c9bb2bf9d52191d36e756e29d1a54caca59488 Jun 03 20:47:23.994711 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:23.994687 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:24.123786 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.123753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:24.571507 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.571473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:24.642750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.642720 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:24.775207 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.775183 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnwxg" event={"ID":"535f4c50-c0c0-4de7-a442-655b5d676392","Type":"ContainerStarted","Data":"6e0290ef130a35726a616b502552a26eb6224fba98378566092af0a81e03e687"} Jun 03 20:47:24.775329 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.775242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnwxg" event={"ID":"535f4c50-c0c0-4de7-a442-655b5d676392","Type":"ContainerStarted","Data":"30a5d41244b611b23a51023533c9bb2bf9d52191d36e756e29d1a54caca59488"} Jun 03 20:47:24.908795 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:24.908762 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.519423 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:25.519389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.780051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:25.779974 2554 generic.go:356] "Generic (PLEG): container finished" podID="535f4c50-c0c0-4de7-a442-655b5d676392" containerID="6e0290ef130a35726a616b502552a26eb6224fba98378566092af0a81e03e687" exitCode=0 Jun 03 20:47:25.780387 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:25.780048 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnwxg" event={"ID":"535f4c50-c0c0-4de7-a442-655b5d676392","Type":"ContainerDied","Data":"6e0290ef130a35726a616b502552a26eb6224fba98378566092af0a81e03e687"} Jun 03 20:47:26.550862 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.550789 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.659413 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.659357 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.752004 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.751974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.785527 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.785499 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnwxg" event={"ID":"535f4c50-c0c0-4de7-a442-655b5d676392","Type":"ContainerStarted","Data":"47aa6e4b1d42e7665ae062e3aa73fb19f9494bd5495f372cbae860650ef4891b"} Jun 03 20:47:26.785871 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.785552 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnwxg" event={"ID":"535f4c50-c0c0-4de7-a442-655b5d676392","Type":"ContainerStarted","Data":"4d097c4c6917823c01b4982ea5dc686f11dcb5fb55bbb77f624f3008e779ebcb"} Jun 03 20:47:26.803755 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.803662 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnwxg" podStartSLOduration=2.9835582819999997 podStartE2EDuration="3.803649092s" totalImagesPullingTime="756.808359ms" totalInitContainerRuntime="63.282451ms" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:26.802713009 +0000 UTC m=+229.256157934" watchObservedRunningTime="2026-06-03 20:47:26.803649092 +0000 UTC m=+229.257094016" Jun 03 20:47:26.973381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:26.973346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:27.895458 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.895421 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5974fdc55-x68gs"] Jun 03 20:47:27.897458 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.897437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.899439 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.899417 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 20:47:27.899528 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.899512 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 20:47:27.900225 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.900208 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 20:47:27.900292 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.900208 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 20:47:27.900419 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.900406 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cd053ti2556nu\"" Jun 03 20:47:27.900467 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.900412 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j66l4\"" Jun 03 20:47:27.907397 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.907378 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5974fdc55-x68gs"] Jun 03 20:47:27.979596 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979569 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-audit-log\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-tls\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9m6\" (UniqueName: \"kubernetes.io/projected/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-kube-api-access-tk9m6\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-client-certs\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-metrics-server-audit-profiles\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979874 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-client-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:27.979874 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:27.979860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-client-certs\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-metrics-server-audit-profiles\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081093 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-client-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081149 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-audit-log\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-tls\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081274 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9m6\" (UniqueName: \"kubernetes.io/projected/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-kube-api-access-tk9m6\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081659 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-audit-log\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.081951 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.081907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.082110 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.082090 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-metrics-server-audit-profiles\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.083613 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.083588 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-client-certs\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.083708 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.083643 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-secret-metrics-server-tls\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.083708 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.083681 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-client-ca-bundle\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.089468 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.089448 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9m6\" (UniqueName: \"kubernetes.io/projected/c65cee4c-00ec-46cb-aeea-18e8ae18fb70-kube-api-access-tk9m6\") pod \"metrics-server-5974fdc55-x68gs\" (UID: \"c65cee4c-00ec-46cb-aeea-18e8ae18fb70\") " pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.206436 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.206359 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:28.327325 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.327297 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5974fdc55-x68gs"] Jun 03 20:47:28.331866 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:47:28.331828 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65cee4c_00ec_46cb_aeea_18e8ae18fb70.slice/crio-21c848a45174e7183319fbd973fb3b75aeab942a812b8f60f94d0f3421767635 WatchSource:0}: Error finding container 21c848a45174e7183319fbd973fb3b75aeab942a812b8f60f94d0f3421767635: Status 404 returned error can't find the container with id 21c848a45174e7183319fbd973fb3b75aeab942a812b8f60f94d0f3421767635 Jun 03 20:47:28.364131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.364108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.466037 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.465953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.562653 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.562628 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.794195 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.794119 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" event={"ID":"c65cee4c-00ec-46cb-aeea-18e8ae18fb70","Type":"ContainerStarted","Data":"21c848a45174e7183319fbd973fb3b75aeab942a812b8f60f94d0f3421767635"} Jun 03 20:47:28.864324 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.864291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.918260 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:28.918226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:29.798753 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.798654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:29.798753 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.798715 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" event={"ID":"c65cee4c-00ec-46cb-aeea-18e8ae18fb70","Type":"ContainerStarted","Data":"f5a7eea981c290a53b6cd164f7acf72538341664c31f17fb06a3787c6130375c"} Jun 03 20:47:29.821907 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.821856 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" podStartSLOduration=1.6093535270000001 podStartE2EDuration="2.821841756s" totalImagesPullingTime="1.212488229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:29.821444663 +0000 UTC m=+232.274889591" watchObservedRunningTime="2026-06-03 20:47:29.821841756 +0000 UTC m=+232.275286709" Jun 03 20:47:29.992407 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.992372 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" podUID="ef7109d7-52e2-412a-8df4-f7ea607a289f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:29.992743 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.992442 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" Jun 03 20:47:29.992868 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.992839 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8ca960cae734db70078ffec4036964f59e68aa6e0eaf8e87fe4c1dd25786f7b5"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 20:47:29.992904 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:29.992886 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" podUID="ef7109d7-52e2-412a-8df4-f7ea607a289f" containerName="service-proxy" containerID="cri-o://8ca960cae734db70078ffec4036964f59e68aa6e0eaf8e87fe4c1dd25786f7b5" gracePeriod=30 Jun 03 20:47:30.803573 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:30.803538 2554 generic.go:356] "Generic (PLEG): container finished" podID="ef7109d7-52e2-412a-8df4-f7ea607a289f" containerID="8ca960cae734db70078ffec4036964f59e68aa6e0eaf8e87fe4c1dd25786f7b5" exitCode=2 Jun 03 20:47:30.803770 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:30.803604 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerDied","Data":"8ca960cae734db70078ffec4036964f59e68aa6e0eaf8e87fe4c1dd25786f7b5"} Jun 03 20:47:30.803770 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:30.803647 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74f4d4464f-tclqb" event={"ID":"ef7109d7-52e2-412a-8df4-f7ea607a289f","Type":"ContainerStarted","Data":"d999b6eb588016d7bc828ca74085348dff3032df564b2adf596c311c47acc688"} Jun 03 20:47:30.886181 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:30.886149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:30.987499 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:30.987465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:34.946839 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:34.946800 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:35.046439 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:35.046407 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:35.147592 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:35.147562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:35.246883 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:35.246801 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:36.571969 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:36.571936 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:36.572321 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:36.571988 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:37.867611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:37.867548 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:37.918820 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:37.918777 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:38.760713 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:38.760677 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:38.760866 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:38.760731 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:46.571794 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:46.571761 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:46.572168 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:46.571813 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:47.423633 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:47.423599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:47.476115 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:47.476064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:48.206692 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.206660 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:48.207092 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.206722 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:47:48.760331 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.760301 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:48.760482 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.760348 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:48.848095 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.844550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:47:48.850371 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.850349 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811b3128-3350-4fa9-bac8-c63ffe694983-metrics-certs\") pod \"network-metrics-daemon-x5c7b\" (UID: \"811b3128-3350-4fa9-bac8-c63ffe694983\") " pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:47:48.857625 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.857607 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:47:48.866342 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.866321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5c7b" Jun 03 20:47:48.989468 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:48.989435 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x5c7b"] Jun 03 20:47:48.993354 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:47:48.993322 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811b3128_3350_4fa9_bac8_c63ffe694983.slice/crio-09ea5ffcaba04cf26241256902ded3d288da880bc778f39f9809876d311721f4 WatchSource:0}: Error finding container 09ea5ffcaba04cf26241256902ded3d288da880bc778f39f9809876d311721f4: Status 404 returned error can't find the container with id 09ea5ffcaba04cf26241256902ded3d288da880bc778f39f9809876d311721f4 Jun 03 20:47:49.865053 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:49.865025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5c7b" event={"ID":"811b3128-3350-4fa9-bac8-c63ffe694983","Type":"ContainerStarted","Data":"ed2a37358a17607919096b54c49e99eeffb7fa7cfa51fba0f141427c9e770202"} Jun 03 20:47:49.865356 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:49.865078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5c7b" event={"ID":"811b3128-3350-4fa9-bac8-c63ffe694983","Type":"ContainerStarted","Data":"09ea5ffcaba04cf26241256902ded3d288da880bc778f39f9809876d311721f4"} Jun 03 20:47:50.861926 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:50.861879 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:50.869798 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:50.869771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5c7b" event={"ID":"811b3128-3350-4fa9-bac8-c63ffe694983","Type":"ContainerStarted","Data":"1014739458fbb2ad51145750455ab9dcff7d8356841a10485b9b6c7875afadee"} Jun 03 20:47:50.887611 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:50.887562 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x5c7b" podStartSLOduration=252.124229588 podStartE2EDuration="4m12.887547993s" totalImagesPullingTime="763.318405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:50.886132259 +0000 UTC m=+253.339577183" watchObservedRunningTime="2026-06-03 20:47:50.887547993 +0000 UTC m=+253.340992960" Jun 03 20:47:50.962288 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:50.962265 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:51.063773 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:51.063745 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:51.236640 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:51.236558 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:51.293643 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:51.293616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:56.572317 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.572282 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:56.572790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.572333 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:56.572790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.572374 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:47:56.572891 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.572808 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"a87212c5787fffd2013715357f65dabb825b127e43a0b1a9daf0f9ca01a643f7"} pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" containerMessage="Container registry failed liveness probe, will be restarted" Jun 03 20:47:56.576337 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.576311 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:56.576485 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.576349 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:56.934422 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:56.934335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:57.032368 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:57.032326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:57.484544 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:57.484509 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:57.545277 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:47:57.545254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:06.402651 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:06.402616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:06.576456 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:06.576422 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:48:06.576606 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:06.576484 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:48:08.211693 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:08.211661 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:48:08.215481 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:08.215460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5974fdc55-x68gs" Jun 03 20:48:15.963106 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:15.963066 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:16.063295 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:16.063268 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:16.577179 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:16.577141 2554 patch_prober.go:28] interesting pod/image-registry-6964d49d65-g7zcb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:48:16.577357 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:16.577206 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:48:18.568033 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:48:18.567992 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2kwnw" podUID="5fd35282-301b-4a08-b1ad-b3ccd9abbdb3" Jun 03 20:48:18.960700 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:18.960622 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:19.150953 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:19.150925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:19.249454 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:19.249353 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:19.349462 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:19.349432 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:21.591543 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:21.591495 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" podUID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerName="registry" containerID="cri-o://a87212c5787fffd2013715357f65dabb825b127e43a0b1a9daf0f9ca01a643f7" gracePeriod=30 Jun 03 20:48:22.381166 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.381132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:22.383598 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.383564 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fd35282-301b-4a08-b1ad-b3ccd9abbdb3-metrics-tls\") pod \"dns-default-2kwnw\" (UID: \"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3\") " pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:22.563865 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.563838 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:48:22.572454 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.572434 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:22.692566 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.692523 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2kwnw"] Jun 03 20:48:22.713857 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:48:22.713827 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd35282_301b_4a08_b1ad_b3ccd9abbdb3.slice/crio-8ffd678e29736b469ef27a82519dd5a53027179af2ef06d91844cb26d3ca8c7d WatchSource:0}: Error finding container 8ffd678e29736b469ef27a82519dd5a53027179af2ef06d91844cb26d3ca8c7d: Status 404 returned error can't find the container with id 8ffd678e29736b469ef27a82519dd5a53027179af2ef06d91844cb26d3ca8c7d Jun 03 20:48:22.975147 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.975060 2554 generic.go:356] "Generic (PLEG): container finished" podID="cd7d499e-5b34-4dea-82d8-07ce00358b76" containerID="a87212c5787fffd2013715357f65dabb825b127e43a0b1a9daf0f9ca01a643f7" exitCode=0 Jun 03 20:48:22.975147 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.975120 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" event={"ID":"cd7d499e-5b34-4dea-82d8-07ce00358b76","Type":"ContainerDied","Data":"a87212c5787fffd2013715357f65dabb825b127e43a0b1a9daf0f9ca01a643f7"} Jun 03 20:48:22.975339 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.975165 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" event={"ID":"cd7d499e-5b34-4dea-82d8-07ce00358b76","Type":"ContainerStarted","Data":"7018adbfb94b529e522ebdb06c920413d32941bf6bdb4e5ef4263e3fdbacbf15"} Jun 03 20:48:22.975389 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.975347 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:48:22.976324 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:22.976306 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2kwnw" event={"ID":"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3","Type":"ContainerStarted","Data":"8ffd678e29736b469ef27a82519dd5a53027179af2ef06d91844cb26d3ca8c7d"} Jun 03 20:48:24.083897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.083851 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:24.133949 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.133904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:24.216227 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.216189 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:24.317102 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.317073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:24.987423 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.987385 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2kwnw" event={"ID":"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3","Type":"ContainerStarted","Data":"c511b4bdb2a7e4a7e44a1ef6142728803fa0e970bfce87709eab39efabf8b788"} Jun 03 20:48:24.987594 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.987463 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2kwnw" event={"ID":"5fd35282-301b-4a08-b1ad-b3ccd9abbdb3","Type":"ContainerStarted","Data":"916299975f13e8a1ec9d6f119ee62c9dc40b0a6adf33585237ff839e631915b3"} Jun 03 20:48:24.987594 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:24.987503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:25.003159 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:25.003115 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2kwnw" podStartSLOduration=251.420435642 podStartE2EDuration="4m13.00310024s" totalImagesPullingTime="1.582664598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:25.001427248 +0000 UTC m=+287.454872174" watchObservedRunningTime="2026-06-03 20:48:25.00310024 +0000 UTC m=+287.456545165" Jun 03 20:48:29.105791 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:29.105736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:29.181806 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:29.181770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:34.386381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:34.386346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:34.488086 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:34.488055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:34.588339 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:34.588303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:34.992390 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:34.992360 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2kwnw" Jun 03 20:48:37.119586 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:37.119553 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:37.908494 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:37.908466 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 20:48:38.181686 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:38.181614 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:38.238766 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:38.238734 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:41.013975 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:41.013942 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:41.065783 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:41.065744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:42.482507 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:42.482473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:42.536255 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:42.536226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:42.846293 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:42.846232 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:43.051211 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:43.051162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:43.987734 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:43.987705 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6964d49d65-g7zcb" Jun 03 20:48:44.099666 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:44.099621 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:44.200651 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:44.200621 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:44.300658 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:44.300628 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:44.402373 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:44.402340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.019479 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:50.019449 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.069656 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:50.069615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:51.612319 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:51.612284 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:51.678766 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:51.678737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:57.482742 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:57.482705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:57.583701 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:48:57.583664 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:02.175018 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:02.174979 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:02.225606 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:02.225573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:02.276074 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:02.276044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:30.779629 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:30.779554 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:58.062826 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:58.062794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:58.111565 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:49:58.111539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:09.891046 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:09.890993 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:09.949476 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:09.949438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:10.631129 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:10.631098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:12.495406 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:12.495362 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:12.596471 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:12.596437 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:12.696452 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:12.696422 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:21.456407 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:21.456369 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:21.510513 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:21.510483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:21.567159 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:21.567130 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:49.127642 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:49.127605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:49.217905 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:50:49.217867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:10.686441 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:10.686408 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:11.469633 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:11.469597 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:14.289536 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:14.289503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:14.390419 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:14.390387 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:15.586664 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:15.586626 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:15.683690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:15.683659 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:15.974908 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:15.974823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:16.087229 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:16.087195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:18.887855 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:18.887821 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:19.472548 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:19.472513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:21.079674 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:21.079638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:21.136228 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:21.136197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:24.128795 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:24.128764 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:24.228899 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:24.228865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.123565 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:27.123519 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.232537 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:27.232505 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.319359 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:27.319326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:33.334745 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:33.334710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:33.435057 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:33.435008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:35.088715 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:35.088682 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:47.888135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:47.888100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:47.982226 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:47.982192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:48.546895 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.546858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:48.766597 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.766566 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:48.872454 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.872430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:48.890230 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.890200 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9"] Jun 03 20:51:48.893186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.893172 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:48.895135 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.895113 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 20:51:48.895253 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.895234 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 20:51:48.895353 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.895336 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zlkj8\"" Jun 03 20:51:48.895443 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.895420 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 20:51:48.895498 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.895435 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 20:51:48.919561 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.919538 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9"] Jun 03 20:51:48.994723 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.994695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:48.994723 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.994723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:48.994892 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.994754 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8krf\" (UniqueName: \"kubernetes.io/projected/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-kube-api-access-p8krf\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:48.994892 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.994841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:48.994892 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:48.994874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.025523 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.025489 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.095649 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.095609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8krf\" (UniqueName: \"kubernetes.io/projected/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-kube-api-access-p8krf\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.095741 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.095666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.095741 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.095695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.095741 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.095725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.095843 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.095745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.096136 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.096117 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.098160 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.098128 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.098246 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.098218 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.098288 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.098263 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.103407 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.103386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8krf\" (UniqueName: \"kubernetes.io/projected/0283981f-904c-4fb6-9dc1-b6cf7c2eff5f-kube-api-access-p8krf\") pod \"opendatahub-operator-controller-manager-5965b9645d-6gbh9\" (UID: \"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.122978 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.122922 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.203027 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.203004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:49.224081 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.224051 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.323855 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.323825 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.338059 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.338034 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9"] Jun 03 20:51:49.341570 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:51:49.341546 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0283981f_904c_4fb6_9dc1_b6cf7c2eff5f.slice/crio-1ebf09507c716b5f1ce558778f85bcaa997d3f6e6707710042e1fca6e157f944 WatchSource:0}: Error finding container 1ebf09507c716b5f1ce558778f85bcaa997d3f6e6707710042e1fca6e157f944: Status 404 returned error can't find the container with id 1ebf09507c716b5f1ce558778f85bcaa997d3f6e6707710042e1fca6e157f944 Jun 03 20:51:49.343384 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.343365 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:51:49.404549 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.404477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.480973 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.480948 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.589753 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.589723 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.637970 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.637943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" event={"ID":"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f","Type":"ContainerStarted","Data":"1ebf09507c716b5f1ce558778f85bcaa997d3f6e6707710042e1fca6e157f944"} Jun 03 20:51:49.680651 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:49.680584 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:52.650298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:52.650262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" event={"ID":"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f","Type":"ContainerStarted","Data":"943ea91f4272213842c9a95399064ba3992fa1c08be020f334940ec60c19853d"} Jun 03 20:51:53.654730 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:53.654698 2554 generic.go:356] "Generic (PLEG): container finished" podID="0283981f-904c-4fb6-9dc1-b6cf7c2eff5f" containerID="943ea91f4272213842c9a95399064ba3992fa1c08be020f334940ec60c19853d" exitCode=0 Jun 03 20:51:53.655121 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:53.654758 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" event={"ID":"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f","Type":"ContainerDied","Data":"943ea91f4272213842c9a95399064ba3992fa1c08be020f334940ec60c19853d"} Jun 03 20:51:54.637413 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:54.637379 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:54.660327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:54.660290 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" event={"ID":"0283981f-904c-4fb6-9dc1-b6cf7c2eff5f","Type":"ContainerStarted","Data":"a680d87e3330cdf5ad4df5185c385c3caa609f669613a51a8fe746268d5e322f"} Jun 03 20:51:54.660781 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:54.660439 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:51:54.679783 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:54.679739 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" podStartSLOduration=2.6244379650000003 podStartE2EDuration="6.679724782s" totalImagesPullingTime="3.149112827s" totalInitContainerRuntime="906.17399ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:54.679078736 +0000 UTC m=+497.132523661" watchObservedRunningTime="2026-06-03 20:51:54.679724782 +0000 UTC m=+497.133169706" Jun 03 20:51:54.703503 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:54.703480 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:59.472312 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:59.472272 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:59.570189 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:51:59.570156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:01.365241 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:01.365212 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:01.472096 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:01.472065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:05.666066 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:05.666039 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-6gbh9" Jun 03 20:52:07.710799 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.710762 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:07.808316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.808281 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w"] Jun 03 20:52:07.814577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.814555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:07.820248 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.820224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 20:52:07.820367 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.820259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 20:52:07.821305 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.821281 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:52:07.821410 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.821317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 20:52:07.821552 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.821539 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6cslz\"" Jun 03 20:52:07.825080 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.825065 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 20:52:07.842732 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.842705 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w"] Jun 03 20:52:07.847791 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.847764 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:07.944255 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.944216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:07.944418 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.944286 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df02a95a-3f8c-420d-bb42-e3b8ce399982-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:07.944418 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.944313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szzwb\" (UniqueName: \"kubernetes.io/projected/df02a95a-3f8c-420d-bb42-e3b8ce399982-kube-api-access-szzwb\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:07.944418 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:07.944361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.013827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.013749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.044718 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.044687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.044888 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.044743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.044992 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.044968 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df02a95a-3f8c-420d-bb42-e3b8ce399982-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.045060 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.045004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szzwb\" (UniqueName: \"kubernetes.io/projected/df02a95a-3f8c-420d-bb42-e3b8ce399982-kube-api-access-szzwb\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.045904 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.045879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df02a95a-3f8c-420d-bb42-e3b8ce399982-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.047767 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.047740 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.047858 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.047839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df02a95a-3f8c-420d-bb42-e3b8ce399982-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.070635 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.070606 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szzwb\" (UniqueName: \"kubernetes.io/projected/df02a95a-3f8c-420d-bb42-e3b8ce399982-kube-api-access-szzwb\") pod \"lws-controller-manager-79d7d4f4f7-7f72w\" (UID: \"df02a95a-3f8c-420d-bb42-e3b8ce399982\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.123070 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.123040 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:08.143343 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.143318 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.236337 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.236305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.276188 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.276109 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w"] Jun 03 20:52:08.279227 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:52:08.279200 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf02a95a_3f8c_420d_bb42_e3b8ce399982.slice/crio-b94d705275a45323eed5a3f463a238dc42e4fd4d0fdd56d13867578d34378087 WatchSource:0}: Error finding container b94d705275a45323eed5a3f463a238dc42e4fd4d0fdd56d13867578d34378087: Status 404 returned error can't find the container with id b94d705275a45323eed5a3f463a238dc42e4fd4d0fdd56d13867578d34378087 Jun 03 20:52:08.393562 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.393523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.491276 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.491247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.588606 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.588578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.692013 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.691982 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:08.707781 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:08.707754 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" event={"ID":"df02a95a-3f8c-420d-bb42-e3b8ce399982","Type":"ContainerStarted","Data":"b94d705275a45323eed5a3f463a238dc42e4fd4d0fdd56d13867578d34378087"} Jun 03 20:52:09.034813 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:09.034715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.170164 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:09.170126 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.271739 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:09.271711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:11.722782 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:11.722691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" event={"ID":"df02a95a-3f8c-420d-bb42-e3b8ce399982","Type":"ContainerStarted","Data":"611a4109c6f0401909b68d9b5dcbc244e818c05298a9a5e8490f6efed4c15fe0"} Jun 03 20:52:11.723223 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:11.722823 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:11.738952 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:11.738886 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" podStartSLOduration=1.665887245 podStartE2EDuration="4.738870457s" totalImagesPullingTime="3.072983212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:11.737674456 +0000 UTC m=+514.191119381" watchObservedRunningTime="2026-06-03 20:52:11.738870457 +0000 UTC m=+514.192315386" Jun 03 20:52:18.312449 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:18.312414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:18.421393 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:18.421358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:18.599579 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:18.599474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:18.767619 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:18.767586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:19.661571 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:19.661533 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:19.824199 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:19.824156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:20.902727 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:20.902695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:21.003490 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:21.003455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:22.727647 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:22.727618 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-7f72w" Jun 03 20:52:28.949764 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:28.949661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:29.039090 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:29.039039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:30.195604 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:30.195556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:31.058698 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:31.058650 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:31.157186 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:31.157141 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:33.076480 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:33.076441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:38.603748 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.603712 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-xrjks"] Jun 03 20:52:38.606976 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.606952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.609702 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.609683 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hdhcr\"" Jun 03 20:52:38.610167 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.610148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 20:52:38.619447 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.619423 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-xrjks"] Jun 03 20:52:38.642129 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.642100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:38.666230 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.666201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d12956e2-4fcc-4df0-9d65-75e82c0b0449-redirect-config\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.666346 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.666276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvn5z\" (UniqueName: \"kubernetes.io/projected/d12956e2-4fcc-4df0-9d65-75e82c0b0449-kube-api-access-jvn5z\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.767488 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.767459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvn5z\" (UniqueName: \"kubernetes.io/projected/d12956e2-4fcc-4df0-9d65-75e82c0b0449-kube-api-access-jvn5z\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.767629 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.767498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d12956e2-4fcc-4df0-9d65-75e82c0b0449-redirect-config\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.768160 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.768143 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d12956e2-4fcc-4df0-9d65-75e82c0b0449-redirect-config\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.775943 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.775907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvn5z\" (UniqueName: \"kubernetes.io/projected/d12956e2-4fcc-4df0-9d65-75e82c0b0449-kube-api-access-jvn5z\") pod \"dashboard-redirect-56dd8b9685-xrjks\" (UID: \"d12956e2-4fcc-4df0-9d65-75e82c0b0449\") " pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:38.916868 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:38.916785 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" Jun 03 20:52:39.045980 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:39.045938 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-xrjks"] Jun 03 20:52:39.048698 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:52:39.048669 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12956e2_4fcc_4df0_9d65_75e82c0b0449.slice/crio-6557154275c817dd749fc80ccdb1d052154997f76f6f328f5955b6fec4e7661d WatchSource:0}: Error finding container 6557154275c817dd749fc80ccdb1d052154997f76f6f328f5955b6fec4e7661d: Status 404 returned error can't find the container with id 6557154275c817dd749fc80ccdb1d052154997f76f6f328f5955b6fec4e7661d Jun 03 20:52:39.817868 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:39.817830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" event={"ID":"d12956e2-4fcc-4df0-9d65-75e82c0b0449","Type":"ContainerStarted","Data":"6557154275c817dd749fc80ccdb1d052154997f76f6f328f5955b6fec4e7661d"} Jun 03 20:52:43.455560 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:43.455509 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:43.556211 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:43.556168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:43.835674 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:43.835642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" event={"ID":"d12956e2-4fcc-4df0-9d65-75e82c0b0449","Type":"ContainerStarted","Data":"99e7257d43449ed2cd969f50a88d90021fde451b086f52e87d3808074763b8b0"} Jun 03 20:52:43.852521 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:43.852474 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56dd8b9685-xrjks" podStartSLOduration=1.259913152 podStartE2EDuration="5.852458393s" totalImagesPullingTime="4.592545241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:43.85087765 +0000 UTC m=+546.304322577" watchObservedRunningTime="2026-06-03 20:52:43.852458393 +0000 UTC m=+546.305903319" Jun 03 20:52:47.244581 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:47.244527 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:47.339984 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:52:47.339935 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:00.335159 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:00.335104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:00.405222 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:00.405174 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:00.753689 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:00.753571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:03.792891 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:03.792837 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:03.894192 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:03.894157 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:04.040124 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.040094 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f"] Jun 03 20:53:04.042075 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.042060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.044145 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.044088 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 20:53:04.044145 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.044092 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 20:53:04.044306 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.044149 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fvv49\"" Jun 03 20:53:04.044306 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.044114 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 20:53:04.053358 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.053336 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f"] Jun 03 20:53:04.075747 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.075719 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:04.156354 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156354 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156373 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjlzg\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-kube-api-access-pjlzg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156443 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156577 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156747 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.156747 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.156599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.199147 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.199118 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:04.257713 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.257713 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.257897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.257897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.257897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjlzg\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-kube-api-access-pjlzg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.257897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.257834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258129 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258218 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258501 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258479 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258558 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258503 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.258618 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.258607 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.260144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.260122 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.260278 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.260262 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.265173 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.265147 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.265250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.265192 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjlzg\" (UniqueName: \"kubernetes.io/projected/bb122fba-c067-4f0c-bfd1-9357ea01e4ef-kube-api-access-pjlzg\") pod \"data-science-gateway-data-science-gateway-class-74759f9795g6s2f\" (UID: \"bb122fba-c067-4f0c-bfd1-9357ea01e4ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.299986 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.299893 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:04.353721 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.353690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:04.485199 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.485172 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f"] Jun 03 20:53:04.487559 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:04.487531 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb122fba_c067_4f0c_bfd1_9357ea01e4ef.slice/crio-3438ced25d4b716b512defbef5a397d94be77839a3cf39f45609347883574a24 WatchSource:0}: Error finding container 3438ced25d4b716b512defbef5a397d94be77839a3cf39f45609347883574a24: Status 404 returned error can't find the container with id 3438ced25d4b716b512defbef5a397d94be77839a3cf39f45609347883574a24 Jun 03 20:53:04.909493 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:04.909457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" event={"ID":"bb122fba-c067-4f0c-bfd1-9357ea01e4ef","Type":"ContainerStarted","Data":"3438ced25d4b716b512defbef5a397d94be77839a3cf39f45609347883574a24"} Jun 03 20:53:06.787092 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:06.787059 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:53:06.787333 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:06.787132 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:53:06.787333 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:06.787161 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:53:06.921734 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:06.921692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" event={"ID":"bb122fba-c067-4f0c-bfd1-9357ea01e4ef","Type":"ContainerStarted","Data":"efe7fe1c747b9e3773b487354a0cba88590461855b9b3436e15e265bfe2cd78c"} Jun 03 20:53:06.943834 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:06.943778 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" podStartSLOduration=0.646645966 podStartE2EDuration="2.943760447s" totalImagesPullingTime="2.297114481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:06.943018674 +0000 UTC m=+569.396463613" watchObservedRunningTime="2026-06-03 20:53:06.943760447 +0000 UTC m=+569.397205373" Jun 03 20:53:07.354155 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:07.354119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:07.355516 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:07.355493 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-74759f9795g6s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body= Jun 03 20:53:07.355603 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:07.355544 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" podUID="bb122fba-c067-4f0c-bfd1-9357ea01e4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" Jun 03 20:53:08.354947 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:08.354896 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-74759f9795g6s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body= Jun 03 20:53:08.355295 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:08.354965 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" podUID="bb122fba-c067-4f0c-bfd1-9357ea01e4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" Jun 03 20:53:08.364397 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:08.364368 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:09.220037 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.220005 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:09.319784 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.319747 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:09.343215 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.343185 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:09.345346 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.345323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:09.347529 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.347509 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:09.347939 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.347901 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:09.348090 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.347908 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-brqm7\"" Jun 03 20:53:09.356706 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.356650 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:09.359094 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.359072 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:09.399524 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.399491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qr79\" (UniqueName: \"kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79\") pod \"kuadrant-operator-catalog-l9k8v\" (UID: \"0bb10b80-bebb-46bf-a270-5750c911850e\") " pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:09.399524 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.399521 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:09.500631 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.500551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qr79\" (UniqueName: \"kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79\") pod \"kuadrant-operator-catalog-l9k8v\" (UID: \"0bb10b80-bebb-46bf-a270-5750c911850e\") " pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:09.507710 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.507676 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qr79\" (UniqueName: \"kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79\") pod \"kuadrant-operator-catalog-l9k8v\" (UID: \"0bb10b80-bebb-46bf-a270-5750c911850e\") " pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:09.655880 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.655848 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:09.711227 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.711198 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:09.781588 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.781438 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:09.783983 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:09.783953 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb10b80_bebb_46bf_a270_5750c911850e.slice/crio-57144d38596e54fb69c147d6d1ef34b28b7a2028d1249cfc53beb3142ec532fe WatchSource:0}: Error finding container 57144d38596e54fb69c147d6d1ef34b28b7a2028d1249cfc53beb3142ec532fe: Status 404 returned error can't find the container with id 57144d38596e54fb69c147d6d1ef34b28b7a2028d1249cfc53beb3142ec532fe Jun 03 20:53:09.914081 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.914053 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzd88"] Jun 03 20:53:09.916371 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.916349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:09.924298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.924271 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzd88"] Jun 03 20:53:09.933759 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.933733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" event={"ID":"0bb10b80-bebb-46bf-a270-5750c911850e","Type":"ContainerStarted","Data":"57144d38596e54fb69c147d6d1ef34b28b7a2028d1249cfc53beb3142ec532fe"} Jun 03 20:53:09.933966 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.933949 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:09.934895 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:09.934877 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795g6s2f" Jun 03 20:53:10.005150 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.005114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dm2r\" (UniqueName: \"kubernetes.io/projected/f8502c2e-5974-4ccd-9caf-66010eec29bd-kube-api-access-9dm2r\") pod \"kuadrant-operator-catalog-kzd88\" (UID: \"f8502c2e-5974-4ccd-9caf-66010eec29bd\") " pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:10.106170 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.106136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dm2r\" (UniqueName: \"kubernetes.io/projected/f8502c2e-5974-4ccd-9caf-66010eec29bd-kube-api-access-9dm2r\") pod \"kuadrant-operator-catalog-kzd88\" (UID: \"f8502c2e-5974-4ccd-9caf-66010eec29bd\") " pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:10.114046 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.114023 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dm2r\" (UniqueName: \"kubernetes.io/projected/f8502c2e-5974-4ccd-9caf-66010eec29bd-kube-api-access-9dm2r\") pod \"kuadrant-operator-catalog-kzd88\" (UID: \"f8502c2e-5974-4ccd-9caf-66010eec29bd\") " pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:10.226093 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.226061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:10.353174 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.353150 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzd88"] Jun 03 20:53:10.365616 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:10.365560 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8502c2e_5974_4ccd_9caf_66010eec29bd.slice/crio-a96394f79d02c9731a6f9c0d97c307ee7d2732cab86f11db6464ced950ea20a7 WatchSource:0}: Error finding container a96394f79d02c9731a6f9c0d97c307ee7d2732cab86f11db6464ced950ea20a7: Status 404 returned error can't find the container with id a96394f79d02c9731a6f9c0d97c307ee7d2732cab86f11db6464ced950ea20a7 Jun 03 20:53:10.940608 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:10.940560 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" event={"ID":"f8502c2e-5974-4ccd-9caf-66010eec29bd","Type":"ContainerStarted","Data":"a96394f79d02c9731a6f9c0d97c307ee7d2732cab86f11db6464ced950ea20a7"} Jun 03 20:53:11.946832 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:11.946781 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" event={"ID":"0bb10b80-bebb-46bf-a270-5750c911850e","Type":"ContainerStarted","Data":"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb"} Jun 03 20:53:11.947299 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:11.946940 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" podUID="0bb10b80-bebb-46bf-a270-5750c911850e" containerName="registry-server" containerID="cri-o://aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb" gracePeriod=2 Jun 03 20:53:11.949516 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:11.949442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" event={"ID":"f8502c2e-5974-4ccd-9caf-66010eec29bd","Type":"ContainerStarted","Data":"9a362904c15c8ed26d4eca9102053010a5e8647eef39bfc1d6ba7f9d99344361"} Jun 03 20:53:11.961255 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:11.961131 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" podStartSLOduration=0.896387587 podStartE2EDuration="2.961112475s" totalImagesPullingTime="2.064724888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:11.960320211 +0000 UTC m=+574.413765136" watchObservedRunningTime="2026-06-03 20:53:11.961112475 +0000 UTC m=+574.414557402" Jun 03 20:53:11.974515 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:11.974465 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" podStartSLOduration=1.479213237 podStartE2EDuration="2.97444615s" totalImagesPullingTime="1.495232913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:11.972684863 +0000 UTC m=+574.426129788" watchObservedRunningTime="2026-06-03 20:53:11.97444615 +0000 UTC m=+574.427891076" Jun 03 20:53:12.181986 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.181964 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l9k8v_0bb10b80-bebb-46bf-a270-5750c911850e/registry-server/0.log" Jun 03 20:53:12.183336 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.183320 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:12.326851 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.326819 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qr79\" (UniqueName: \"kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79\") pod \"0bb10b80-bebb-46bf-a270-5750c911850e\" (UID: \"0bb10b80-bebb-46bf-a270-5750c911850e\") " Jun 03 20:53:12.329041 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.329018 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79" (OuterVolumeSpecName: "kube-api-access-7qr79") pod "0bb10b80-bebb-46bf-a270-5750c911850e" (UID: "0bb10b80-bebb-46bf-a270-5750c911850e"). InnerVolumeSpecName "kube-api-access-7qr79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:12.427544 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.427475 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qr79\" (UniqueName: \"kubernetes.io/projected/0bb10b80-bebb-46bf-a270-5750c911850e-kube-api-access-7qr79\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:53:12.955501 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955142 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l9k8v_0bb10b80-bebb-46bf-a270-5750c911850e/registry-server/0.log" Jun 03 20:53:12.955501 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955275 2554 generic.go:356] "Generic (PLEG): container finished" podID="0bb10b80-bebb-46bf-a270-5750c911850e" containerID="aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb" exitCode=2 Jun 03 20:53:12.956018 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955567 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" Jun 03 20:53:12.956018 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" event={"ID":"0bb10b80-bebb-46bf-a270-5750c911850e","Type":"ContainerDied","Data":"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb"} Jun 03 20:53:12.956018 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9k8v" event={"ID":"0bb10b80-bebb-46bf-a270-5750c911850e","Type":"ContainerDied","Data":"57144d38596e54fb69c147d6d1ef34b28b7a2028d1249cfc53beb3142ec532fe"} Jun 03 20:53:12.956018 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.955706 2554 scope.go:117] "RemoveContainer" containerID="aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb" Jun 03 20:53:12.964158 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.964140 2554 scope.go:117] "RemoveContainer" containerID="aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb" Jun 03 20:53:12.964389 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:53:12.964372 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb\": container with ID starting with aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb not found: ID does not exist" containerID="aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb" Jun 03 20:53:12.964437 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.964396 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb"} err="failed to get container status \"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb\": rpc error: code = NotFound desc = could not find container \"aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb\": container with ID starting with aeab4d3b2920df3712d28c84bb2449f1291ad86bea70b660b16fb4cf823835fb not found: ID does not exist" Jun 03 20:53:12.974482 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.974365 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:12.976126 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:12.976106 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9k8v"] Jun 03 20:53:13.958208 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:13.958171 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb10b80-bebb-46bf-a270-5750c911850e" path="/var/lib/kubelet/pods/0bb10b80-bebb-46bf-a270-5750c911850e/volumes" Jun 03 20:53:14.180269 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:14.180236 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:14.230303 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:14.230211 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:20.226543 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:20.226505 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:20.226983 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:20.226563 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:20.247889 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:20.247858 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:21.004745 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:21.004715 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kzd88" Jun 03 20:53:37.860931 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:37.860890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:40.518129 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.518094 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2"] Jun 03 20:53:40.519465 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.518371 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb10b80-bebb-46bf-a270-5750c911850e" containerName="registry-server" Jun 03 20:53:40.519465 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.518383 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb10b80-bebb-46bf-a270-5750c911850e" containerName="registry-server" Jun 03 20:53:40.519465 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.518435 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb10b80-bebb-46bf-a270-5750c911850e" containerName="registry-server" Jun 03 20:53:40.519990 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.519974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:40.523345 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.523322 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jdclr\"" Jun 03 20:53:40.536473 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.536451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2"] Jun 03 20:53:40.554290 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.554265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrh27\" (UniqueName: \"kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27\") pod \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" (UID: \"dec60c8f-4047-436d-8b52-d6eeb426ed5d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:40.655518 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.655490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrh27\" (UniqueName: \"kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27\") pod \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" (UID: \"dec60c8f-4047-436d-8b52-d6eeb426ed5d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:40.665906 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.665879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrh27\" (UniqueName: \"kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27\") pod \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" (UID: \"dec60c8f-4047-436d-8b52-d6eeb426ed5d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:40.829826 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.829802 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:40.959699 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:40.959667 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2"] Jun 03 20:53:40.962534 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:40.962510 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec60c8f_4047_436d_8b52_d6eeb426ed5d.slice/crio-e2e47f6c7b6c8d1ffc9cf8c94c4b7abcc20ccd7a722f8745b6719e504ba9452c WatchSource:0}: Error finding container e2e47f6c7b6c8d1ffc9cf8c94c4b7abcc20ccd7a722f8745b6719e504ba9452c: Status 404 returned error can't find the container with id e2e47f6c7b6c8d1ffc9cf8c94c4b7abcc20ccd7a722f8745b6719e504ba9452c Jun 03 20:53:41.059540 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:41.059503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" event={"ID":"dec60c8f-4047-436d-8b52-d6eeb426ed5d","Type":"ContainerStarted","Data":"e2e47f6c7b6c8d1ffc9cf8c94c4b7abcc20ccd7a722f8745b6719e504ba9452c"} Jun 03 20:53:41.466107 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:41.466042 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:41.566079 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:41.566045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:43.070013 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:43.069975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" event={"ID":"dec60c8f-4047-436d-8b52-d6eeb426ed5d","Type":"ContainerStarted","Data":"011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e"} Jun 03 20:53:43.070418 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:43.070148 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:43.096000 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:43.095956 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" podStartSLOduration=1.1494140210000001 podStartE2EDuration="3.095941312s" totalImagesPullingTime="1.946527291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:43.094745752 +0000 UTC m=+605.548190676" watchObservedRunningTime="2026-06-03 20:53:43.095941312 +0000 UTC m=+605.549386237" Jun 03 20:53:46.475210 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:46.475178 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:46.705179 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:46.705139 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:48.621810 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.621780 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn"] Jun 03 20:53:48.624144 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.624128 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:48.626791 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.626754 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 20:53:48.627322 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.627309 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cc6g9\"" Jun 03 20:53:48.655603 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.655581 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn"] Jun 03 20:53:48.716685 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.716658 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j6h5\" (UniqueName: \"kubernetes.io/projected/e8c71b32-1548-4856-b242-1e9c4f0a7e6b-kube-api-access-5j6h5\") pod \"dns-operator-controller-manager-864dd78c4c-ppchn\" (UID: \"e8c71b32-1548-4856-b242-1e9c4f0a7e6b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:48.817887 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.817859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j6h5\" (UniqueName: \"kubernetes.io/projected/e8c71b32-1548-4856-b242-1e9c4f0a7e6b-kube-api-access-5j6h5\") pod \"dns-operator-controller-manager-864dd78c4c-ppchn\" (UID: \"e8c71b32-1548-4856-b242-1e9c4f0a7e6b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:48.833029 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.833005 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j6h5\" (UniqueName: \"kubernetes.io/projected/e8c71b32-1548-4856-b242-1e9c4f0a7e6b-kube-api-access-5j6h5\") pod \"dns-operator-controller-manager-864dd78c4c-ppchn\" (UID: \"e8c71b32-1548-4856-b242-1e9c4f0a7e6b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:48.904207 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.904132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:48.934182 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:48.934162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:49.099396 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:49.099363 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn"] Jun 03 20:53:49.103070 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:49.103041 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c71b32_1548_4856_b242_1e9c4f0a7e6b.slice/crio-2aa3c8c2f6a69697ee83e62d059c2a0bb28bd77089ead0ceaec145a62c46064b WatchSource:0}: Error finding container 2aa3c8c2f6a69697ee83e62d059c2a0bb28bd77089ead0ceaec145a62c46064b: Status 404 returned error can't find the container with id 2aa3c8c2f6a69697ee83e62d059c2a0bb28bd77089ead0ceaec145a62c46064b Jun 03 20:53:49.172956 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:49.172863 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:49.319801 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:49.319760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:50.097741 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:50.097707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" event={"ID":"e8c71b32-1548-4856-b242-1e9c4f0a7e6b","Type":"ContainerStarted","Data":"2aa3c8c2f6a69697ee83e62d059c2a0bb28bd77089ead0ceaec145a62c46064b"} Jun 03 20:53:51.103525 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:51.103489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" event={"ID":"e8c71b32-1548-4856-b242-1e9c4f0a7e6b","Type":"ContainerStarted","Data":"2189cdb856daee60b68a930acbb21c33f37cdfa2edd1188a8561348d051c5e31"} Jun 03 20:53:51.103878 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:51.103569 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:53:51.567604 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:51.567569 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.118506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.118473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.219197 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.219160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.320200 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.320168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.353636 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.353554 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" podStartSLOduration=2.992614802 podStartE2EDuration="4.353530737s" totalImagesPullingTime="1.360915935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:51.132700397 +0000 UTC m=+613.586145322" watchObservedRunningTime="2026-06-03 20:53:52.353530737 +0000 UTC m=+614.806975663" Jun 03 20:53:52.354250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.354229 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5"] Jun 03 20:53:52.356383 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.356364 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.360412 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.360393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 20:53:52.360747 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.360721 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 20:53:52.360986 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.360973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zxcz\"" Jun 03 20:53:52.426951 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.426852 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5"] Jun 03 20:53:52.445754 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.445727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.450892 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.450864 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.451011 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.450941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.451011 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.450965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkjt7\" (UniqueName: \"kubernetes.io/projected/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-kube-api-access-bkjt7\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.551859 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.551821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.552043 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.551888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.552043 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.551941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkjt7\" (UniqueName: \"kubernetes.io/projected/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-kube-api-access-bkjt7\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.552114 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:53:52.552049 2554 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 03 20:53:52.552156 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:53:52.552118 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert podName:c2dcfab0-b556-4ee3-83f5-b4e5a1fab254 nodeName:}" failed. No retries permitted until 2026-06-03 20:53:53.052100311 +0000 UTC m=+615.505545222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-48tl5" (UID: "c2dcfab0-b556-4ee3-83f5-b4e5a1fab254") : secret "plugin-serving-cert" not found Jun 03 20:53:52.552461 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.552443 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.573722 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.573698 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkjt7\" (UniqueName: \"kubernetes.io/projected/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-kube-api-access-bkjt7\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:52.755438 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.755351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.885386 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:52.885352 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:53.056984 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.056954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:53.059309 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.059290 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dcfab0-b556-4ee3-83f5-b4e5a1fab254-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48tl5\" (UID: \"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:53.265149 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.265113 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" Jun 03 20:53:53.397643 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.397614 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5"] Jun 03 20:53:53.401417 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:53:53.401392 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2dcfab0_b556_4ee3_83f5_b4e5a1fab254.slice/crio-b8ed44663e37b93ead02a1298a81cc109b6f0fa0e66fa79ae1a852b77a31378c WatchSource:0}: Error finding container b8ed44663e37b93ead02a1298a81cc109b6f0fa0e66fa79ae1a852b77a31378c: Status 404 returned error can't find the container with id b8ed44663e37b93ead02a1298a81cc109b6f0fa0e66fa79ae1a852b77a31378c Jun 03 20:53:53.487997 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.487972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:53.586842 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:53.586752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:54.076366 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:54.076336 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:53:54.118534 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:54.118497 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" event={"ID":"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254","Type":"ContainerStarted","Data":"b8ed44663e37b93ead02a1298a81cc109b6f0fa0e66fa79ae1a852b77a31378c"} Jun 03 20:53:56.906480 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:56.906445 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:56.991837 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:53:56.991795 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:02.110315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:02.110282 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ppchn" Jun 03 20:54:03.115106 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.115065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.345180 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.345144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.466944 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.466837 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2"] Jun 03 20:54:03.467107 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.467081 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" containerName="manager" containerID="cri-o://011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e" gracePeriod=2 Jun 03 20:54:03.483940 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.483896 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2"] Jun 03 20:54:03.492436 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:03.492390 2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dec60c8f-4047-436d-8b52-d6eeb426ed5d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-5kbt2\": pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:03.508233 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.508204 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.528281 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.528247 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs"] Jun 03 20:54:03.528751 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.528729 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" containerName="manager" Jun 03 20:54:03.528830 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.528753 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" containerName="manager" Jun 03 20:54:03.528865 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.528839 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" containerName="manager" Jun 03 20:54:03.538244 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.538215 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:03.541268 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:03.541232 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:03.554715 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.554198 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs"] Jun 03 20:54:03.651732 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.651693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47262\" (UniqueName: \"kubernetes.io/projected/fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f-kube-api-access-47262\") pod \"limitador-operator-controller-manager-859d7b78bd-tsmbs\" (UID: \"fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:03.752381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.752292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47262\" (UniqueName: \"kubernetes.io/projected/fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f-kube-api-access-47262\") pod \"limitador-operator-controller-manager-859d7b78bd-tsmbs\" (UID: \"fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:03.771572 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.771545 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47262\" (UniqueName: \"kubernetes.io/projected/fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f-kube-api-access-47262\") pod \"limitador-operator-controller-manager-859d7b78bd-tsmbs\" (UID: \"fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:03.859686 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:03.859650 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:05.456539 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.456496 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 20:54:05.505132 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.505093 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 20:54:05.505269 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.505231 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.510278 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.510254 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-66zz9\"" Jun 03 20:54:05.568251 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.568222 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn5xb\" (UniqueName: \"kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.568402 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.568334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.668979 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.668942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.669136 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.669026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn5xb\" (UniqueName: \"kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.669423 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.669404 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.678305 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.678281 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn5xb\" (UniqueName: \"kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb\") pod \"kuadrant-operator-controller-manager-86878c769f-rkt86\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:05.817576 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:05.817540 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:09.676212 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:09.676171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:09.839149 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:09.839111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:10.012600 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:10.012512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:12.390232 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:12.390186 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:12.552348 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:12.552309 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:13.895075 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:13.895051 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:13.898704 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:13.898679 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:13.916408 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:13.916373 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs"] Jun 03 20:54:13.919995 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:54:13.919972 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd14a7b7_637a_4ddf_bca8_6d3201dc1a3f.slice/crio-2548eb8e06906c21fb86ca81c491c3984f26d9b56bb5495bb7bded100244b6b7 WatchSource:0}: Error finding container 2548eb8e06906c21fb86ca81c491c3984f26d9b56bb5495bb7bded100244b6b7: Status 404 returned error can't find the container with id 2548eb8e06906c21fb86ca81c491c3984f26d9b56bb5495bb7bded100244b6b7 Jun 03 20:54:13.939994 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:13.939970 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 20:54:13.950045 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:54:13.950017 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0479ffea_8f65_4916_b40a_1ba00b0645e5.slice/crio-eb8e02a750a132fcf1947fd26ee522f41839738092df6d7b994f774dfb5b4eb9 WatchSource:0}: Error finding container eb8e02a750a132fcf1947fd26ee522f41839738092df6d7b994f774dfb5b4eb9: Status 404 returned error can't find the container with id eb8e02a750a132fcf1947fd26ee522f41839738092df6d7b994f774dfb5b4eb9 Jun 03 20:54:14.046000 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.045904 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrh27\" (UniqueName: \"kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27\") pod \"dec60c8f-4047-436d-8b52-d6eeb426ed5d\" (UID: \"dec60c8f-4047-436d-8b52-d6eeb426ed5d\") " Jun 03 20:54:14.047954 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.047929 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27" (OuterVolumeSpecName: "kube-api-access-zrh27") pod "dec60c8f-4047-436d-8b52-d6eeb426ed5d" (UID: "dec60c8f-4047-436d-8b52-d6eeb426ed5d"). InnerVolumeSpecName "kube-api-access-zrh27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:14.147092 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.147064 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrh27\" (UniqueName: \"kubernetes.io/projected/dec60c8f-4047-436d-8b52-d6eeb426ed5d-kube-api-access-zrh27\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:54:14.217187 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.217152 2554 generic.go:356] "Generic (PLEG): container finished" podID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" containerID="011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e" exitCode=0 Jun 03 20:54:14.217376 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.217200 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:14.217376 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.217238 2554 scope.go:117] "RemoveContainer" containerID="011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e" Jun 03 20:54:14.218803 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.218763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" event={"ID":"c2dcfab0-b556-4ee3-83f5-b4e5a1fab254","Type":"ContainerStarted","Data":"37398c3d4dd85ea60c9332194d322dd92d879a8a239419663fec2286d3fd7102"} Jun 03 20:54:14.220155 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.220133 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" event={"ID":"0479ffea-8f65-4916-b40a-1ba00b0645e5","Type":"ContainerStarted","Data":"eb8e02a750a132fcf1947fd26ee522f41839738092df6d7b994f774dfb5b4eb9"} Jun 03 20:54:14.221326 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:14.221295 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:14.221855 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.221831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" event={"ID":"fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f","Type":"ContainerStarted","Data":"373d5a93f517c4c5ddcd33cc407c4082940ce649f43b4927ef933337f72dd117"} Jun 03 20:54:14.221987 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.221878 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" event={"ID":"fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f","Type":"ContainerStarted","Data":"2548eb8e06906c21fb86ca81c491c3984f26d9b56bb5495bb7bded100244b6b7"} Jun 03 20:54:14.221987 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.221967 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:14.225584 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.225567 2554 scope.go:117] "RemoveContainer" containerID="011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e" Jun 03 20:54:14.225878 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:14.225851 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e\": container with ID starting with 011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e not found: ID does not exist" containerID="011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e" Jun 03 20:54:14.225969 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.225887 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e"} err="failed to get container status \"011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e\": rpc error: code = NotFound desc = could not find container \"011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e\": container with ID starting with 011c34bf3186250cc0d2302a08bf7a53cb929058ddc82b2b47b1a9208c30e83e not found: ID does not exist" Jun 03 20:54:14.248431 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.248387 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48tl5" podStartSLOduration=1.829916952 podStartE2EDuration="22.248370436s" totalImagesPullingTime="20.418453484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:14.247507744 +0000 UTC m=+636.700952670" watchObservedRunningTime="2026-06-03 20:54:14.248370436 +0000 UTC m=+636.701815361" Jun 03 20:54:14.249111 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:14.249090 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:14.278319 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.278158 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" podStartSLOduration=11.278142258 podStartE2EDuration="11.278142258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:14.276300407 +0000 UTC m=+636.729745332" watchObservedRunningTime="2026-06-03 20:54:14.278142258 +0000 UTC m=+636.731587184" Jun 03 20:54:14.278319 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:54:14.278230 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5kbt2\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5kbt2" Jun 03 20:54:14.953589 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:14.953557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:15.055871 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:15.055832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:15.960204 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:15.960168 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec60c8f-4047-436d-8b52-d6eeb426ed5d" path="/var/lib/kubelet/pods/dec60c8f-4047-436d-8b52-d6eeb426ed5d/volumes" Jun 03 20:54:19.249965 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:19.249873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" event={"ID":"0479ffea-8f65-4916-b40a-1ba00b0645e5","Type":"ContainerStarted","Data":"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01"} Jun 03 20:54:19.250324 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:19.249978 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:19.286108 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:19.286059 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" podStartSLOduration=9.30796688 podStartE2EDuration="14.286038459s" totalImagesPullingTime="4.978071579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:19.284570273 +0000 UTC m=+641.738015199" watchObservedRunningTime="2026-06-03 20:54:19.286038459 +0000 UTC m=+641.739483384" Jun 03 20:54:21.906240 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:21.906201 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:22.073314 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:22.073273 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:25.231243 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:25.231216 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsmbs" Jun 03 20:54:28.372310 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:28.372275 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:28.482762 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:28.482729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:28.676252 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:28.676171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:30.261371 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:30.261343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 20:54:37.422103 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:37.422073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:46.814077 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.814040 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j"] Jun 03 20:54:46.850027 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.849999 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j"] Jun 03 20:54:46.850169 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.850092 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.853123 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.853105 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xj7sr\"" Jun 03 20:54:46.873102 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.873067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:46.900128 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900226 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b69fm\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-kube-api-access-b69fm\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900226 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900226 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900181 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a88e964-33bd-433d-b151-8e0cd946ff61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.900327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.900310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:46.969564 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:46.969531 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:47.001357 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b69fm\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-kube-api-access-b69fm\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001703 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a88e964-33bd-433d-b151-8e0cd946ff61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001703 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001703 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.001902 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001877 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.002016 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.001995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.002068 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.002034 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.002103 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.002068 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.002264 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.002247 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a88e964-33bd-433d-b151-8e0cd946ff61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.003748 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.003728 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.004020 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.003998 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.020927 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.020884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.021042 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.021025 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b69fm\" (UniqueName: \"kubernetes.io/projected/4a88e964-33bd-433d-b151-8e0cd946ff61-kube-api-access-b69fm\") pod \"maas-default-gateway-openshift-default-687ff6996-j8x5j\" (UID: \"4a88e964-33bd-433d-b151-8e0cd946ff61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.160796 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.160695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:47.298406 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.298384 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j"] Jun 03 20:54:47.300532 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:54:47.300507 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a88e964_33bd_433d_b151_8e0cd946ff61.slice/crio-cb2919abc40317078bc883505f2dd2ce471339f751bd4f976628869dad59edd2 WatchSource:0}: Error finding container cb2919abc40317078bc883505f2dd2ce471339f751bd4f976628869dad59edd2: Status 404 returned error can't find the container with id cb2919abc40317078bc883505f2dd2ce471339f751bd4f976628869dad59edd2 Jun 03 20:54:47.302490 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.302460 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:54:47.302555 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.302519 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:54:47.302555 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.302548 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:54:47.373603 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:47.373578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" event={"ID":"4a88e964-33bd-433d-b151-8e0cd946ff61","Type":"ContainerStarted","Data":"cb2919abc40317078bc883505f2dd2ce471339f751bd4f976628869dad59edd2"} Jun 03 20:54:48.379909 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:48.379872 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" event={"ID":"4a88e964-33bd-433d-b151-8e0cd946ff61","Type":"ContainerStarted","Data":"421fa24852a4e2a0916f63c20a04709b20162267ac9efaa23e82affd7c40f4a1"} Jun 03 20:54:48.407475 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:48.407423 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podStartSLOduration=2.407408344 podStartE2EDuration="2.407408344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:48.406004056 +0000 UTC m=+670.859448981" watchObservedRunningTime="2026-06-03 20:54:48.407408344 +0000 UTC m=+670.860853268" Jun 03 20:54:49.161297 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:49.161260 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:49.165940 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:49.165897 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:49.384849 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:49.384816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:49.385899 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:49.385880 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:54:50.422376 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:50.422347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:51.037134 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:51.037098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:51.136418 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:51.136385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:51.302507 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:51.302479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:51.855277 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:51.855244 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:51.951761 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:51.951730 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:52.145454 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.145382 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:54:52.148796 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.148772 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:54:52.150907 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.150890 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qq9b6\"" Jun 03 20:54:52.158032 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.158012 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:54:52.246061 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.246027 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtkz\" (UniqueName: \"kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz\") pod \"authorino-75d556bd77-b9nbq\" (UID: \"a117aa60-c4c6-4419-98c0-6113f5b33458\") " pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:54:52.346738 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.346703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtkz\" (UniqueName: \"kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz\") pod \"authorino-75d556bd77-b9nbq\" (UID: \"a117aa60-c4c6-4419-98c0-6113f5b33458\") " pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:54:52.355901 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.355876 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtkz\" (UniqueName: \"kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz\") pod \"authorino-75d556bd77-b9nbq\" (UID: \"a117aa60-c4c6-4419-98c0-6113f5b33458\") " pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:54:52.458881 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.458795 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:54:52.612252 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:52.612228 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:54:52.614792 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:54:52.614760 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda117aa60_c4c6_4419_98c0_6113f5b33458.slice/crio-fb9b77909490f1e8e64be9a1c21c5a28beb76e2813c1a981faa7052ab307ed57 WatchSource:0}: Error finding container fb9b77909490f1e8e64be9a1c21c5a28beb76e2813c1a981faa7052ab307ed57: Status 404 returned error can't find the container with id fb9b77909490f1e8e64be9a1c21c5a28beb76e2813c1a981faa7052ab307ed57 Jun 03 20:54:53.411349 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:53.411284 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9nbq" event={"ID":"a117aa60-c4c6-4419-98c0-6113f5b33458","Type":"ContainerStarted","Data":"fb9b77909490f1e8e64be9a1c21c5a28beb76e2813c1a981faa7052ab307ed57"} Jun 03 20:54:53.516343 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:53.516308 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:53.614574 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:53.614527 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:56.426501 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:56.426468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9nbq" event={"ID":"a117aa60-c4c6-4419-98c0-6113f5b33458","Type":"ContainerStarted","Data":"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5"} Jun 03 20:54:56.442078 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:54:56.442035 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b9nbq" podStartSLOduration=1.6494669050000001 podStartE2EDuration="4.442021045s" totalImagesPullingTime="2.79255414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:56.441230555 +0000 UTC m=+678.894675477" watchObservedRunningTime="2026-06-03 20:54:56.442021045 +0000 UTC m=+678.895465970" Jun 03 20:55:11.996809 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:11.996776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:24.378877 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:24.378836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:24.465199 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:24.465166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:24.635679 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:24.635595 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:48.301196 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:48.301116 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:48.401002 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:55:48.400968 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:17.780844 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:17.780807 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:18.001782 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.001747 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8cr7t"] Jun 03 20:56:18.004001 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.003977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.011559 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.011537 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8cr7t"] Jun 03 20:56:18.150429 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.150397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht4cr\" (UniqueName: \"kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr\") pod \"authorino-5d4b67c446-8cr7t\" (UID: \"d63d611c-d95f-412c-a642-c01b5b83ba96\") " pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.219020 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.218995 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8cr7t"] Jun 03 20:56:18.219227 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:56:18.219207 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ht4cr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-8cr7t" podUID="d63d611c-d95f-412c-a642-c01b5b83ba96" Jun 03 20:56:18.241719 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.241695 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:18.243945 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.243909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:18.253419 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.253393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht4cr\" (UniqueName: \"kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr\") pod \"authorino-5d4b67c446-8cr7t\" (UID: \"d63d611c-d95f-412c-a642-c01b5b83ba96\") " pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.253721 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.253697 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:18.264503 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.264475 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht4cr\" (UniqueName: \"kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr\") pod \"authorino-5d4b67c446-8cr7t\" (UID: \"d63d611c-d95f-412c-a642-c01b5b83ba96\") " pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.354413 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.354378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsnr\" (UniqueName: \"kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr\") pod \"authorino-869c46f478-jlbgl\" (UID: \"22effd5b-9535-41fa-9b95-8b8fa137c6ef\") " pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:18.407966 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.407862 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:18.455059 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.455027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsnr\" (UniqueName: \"kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr\") pod \"authorino-869c46f478-jlbgl\" (UID: \"22effd5b-9535-41fa-9b95-8b8fa137c6ef\") " pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:18.463284 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.463258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsnr\" (UniqueName: \"kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr\") pod \"authorino-869c46f478-jlbgl\" (UID: \"22effd5b-9535-41fa-9b95-8b8fa137c6ef\") " pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:18.560012 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.559982 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:18.683085 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.682966 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:18.685706 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:56:18.685680 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22effd5b_9535_41fa_9b95_8b8fa137c6ef.slice/crio-ace7ad0bd7b93d52b82567b4935dc460f4e26ceadf9c37c31907e782794e2e14 WatchSource:0}: Error finding container ace7ad0bd7b93d52b82567b4935dc460f4e26ceadf9c37c31907e782794e2e14: Status 404 returned error can't find the container with id ace7ad0bd7b93d52b82567b4935dc460f4e26ceadf9c37c31907e782794e2e14 Jun 03 20:56:18.768053 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.768018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c46f478-jlbgl" event={"ID":"22effd5b-9535-41fa-9b95-8b8fa137c6ef","Type":"ContainerStarted","Data":"ace7ad0bd7b93d52b82567b4935dc460f4e26ceadf9c37c31907e782794e2e14"} Jun 03 20:56:18.768190 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.768062 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.775448 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.775426 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:18.859684 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.859656 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht4cr\" (UniqueName: \"kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr\") pod \"d63d611c-d95f-412c-a642-c01b5b83ba96\" (UID: \"d63d611c-d95f-412c-a642-c01b5b83ba96\") " Jun 03 20:56:18.861719 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.861695 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr" (OuterVolumeSpecName: "kube-api-access-ht4cr") pod "d63d611c-d95f-412c-a642-c01b5b83ba96" (UID: "d63d611c-d95f-412c-a642-c01b5b83ba96"). InnerVolumeSpecName "kube-api-access-ht4cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:18.960970 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:18.960895 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht4cr\" (UniqueName: \"kubernetes.io/projected/d63d611c-d95f-412c-a642-c01b5b83ba96-kube-api-access-ht4cr\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:56:19.097179 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.097147 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:19.131527 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.131485 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:56:19.134051 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.134030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.136142 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.136122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 20:56:19.143254 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.143231 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:56:19.263285 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.263207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6sr2\" (UniqueName: \"kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.263285 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.263249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.364716 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.364686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.364887 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.364760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6sr2\" (UniqueName: \"kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.367194 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.367167 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.371827 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.371804 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6sr2\" (UniqueName: \"kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2\") pod \"authorino-65b95fc674-5lrsc\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.444097 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.444062 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:56:19.582845 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.582802 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:56:19.586363 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:56:19.586334 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce20bf2e_b955_4ef2_8305_889723423a02.slice/crio-c64c154bfb221af4871b4c1fcf6e4e128c20bbe3cc4f936e4514f19127061479 WatchSource:0}: Error finding container c64c154bfb221af4871b4c1fcf6e4e128c20bbe3cc4f936e4514f19127061479: Status 404 returned error can't find the container with id c64c154bfb221af4871b4c1fcf6e4e128c20bbe3cc4f936e4514f19127061479 Jun 03 20:56:19.773193 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.773152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b95fc674-5lrsc" event={"ID":"ce20bf2e-b955-4ef2-8305-889723423a02","Type":"ContainerStarted","Data":"c64c154bfb221af4871b4c1fcf6e4e128c20bbe3cc4f936e4514f19127061479"} Jun 03 20:56:19.774750 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.774723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c46f478-jlbgl" event={"ID":"22effd5b-9535-41fa-9b95-8b8fa137c6ef","Type":"ContainerStarted","Data":"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d"} Jun 03 20:56:19.774888 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.774754 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8cr7t" Jun 03 20:56:19.792036 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.791933 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-869c46f478-jlbgl" podStartSLOduration=1.488170326 podStartE2EDuration="1.791902778s" totalImagesPullingTime="303.732452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:19.790004741 +0000 UTC m=+762.243449677" watchObservedRunningTime="2026-06-03 20:56:19.791902778 +0000 UTC m=+762.245347732" Jun 03 20:56:19.813663 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.813632 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8cr7t"] Jun 03 20:56:19.818598 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.818576 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8cr7t"] Jun 03 20:56:19.960148 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:19.960120 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63d611c-d95f-412c-a642-c01b5b83ba96" path="/var/lib/kubelet/pods/d63d611c-d95f-412c-a642-c01b5b83ba96/volumes" Jun 03 20:56:20.780617 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:20.780583 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b95fc674-5lrsc" event={"ID":"ce20bf2e-b955-4ef2-8305-889723423a02","Type":"ContainerStarted","Data":"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53"} Jun 03 20:56:20.780789 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:20.780637 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-869c46f478-jlbgl" podUID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" containerName="authorino" containerID="cri-o://8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d" gracePeriod=30 Jun 03 20:56:20.814268 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:20.814221 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65b95fc674-5lrsc" podStartSLOduration=1.444747414 podStartE2EDuration="1.814206622s" totalImagesPullingTime="369.459208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:20.812200207 +0000 UTC m=+763.265645131" watchObservedRunningTime="2026-06-03 20:56:20.814206622 +0000 UTC m=+763.267651546" Jun 03 20:56:20.844373 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:20.844342 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:56:20.844554 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:20.844534 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b9nbq" podUID="a117aa60-c4c6-4419-98c0-6113f5b33458" containerName="authorino" containerID="cri-o://03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5" gracePeriod=30 Jun 03 20:56:21.084323 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.084303 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:21.100654 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.100636 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:56:21.181738 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.181697 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnsnr\" (UniqueName: \"kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr\") pod \"22effd5b-9535-41fa-9b95-8b8fa137c6ef\" (UID: \"22effd5b-9535-41fa-9b95-8b8fa137c6ef\") " Jun 03 20:56:21.181897 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.181807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdtkz\" (UniqueName: \"kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz\") pod \"a117aa60-c4c6-4419-98c0-6113f5b33458\" (UID: \"a117aa60-c4c6-4419-98c0-6113f5b33458\") " Jun 03 20:56:21.183739 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.183712 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr" (OuterVolumeSpecName: "kube-api-access-nnsnr") pod "22effd5b-9535-41fa-9b95-8b8fa137c6ef" (UID: "22effd5b-9535-41fa-9b95-8b8fa137c6ef"). InnerVolumeSpecName "kube-api-access-nnsnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:21.183828 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.183756 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz" (OuterVolumeSpecName: "kube-api-access-jdtkz") pod "a117aa60-c4c6-4419-98c0-6113f5b33458" (UID: "a117aa60-c4c6-4419-98c0-6113f5b33458"). InnerVolumeSpecName "kube-api-access-jdtkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:21.282381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.282354 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdtkz\" (UniqueName: \"kubernetes.io/projected/a117aa60-c4c6-4419-98c0-6113f5b33458-kube-api-access-jdtkz\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:56:21.282381 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.282380 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnsnr\" (UniqueName: \"kubernetes.io/projected/22effd5b-9535-41fa-9b95-8b8fa137c6ef-kube-api-access-nnsnr\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:56:21.785365 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.785331 2554 generic.go:356] "Generic (PLEG): container finished" podID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" containerID="8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d" exitCode=0 Jun 03 20:56:21.785556 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.785372 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c46f478-jlbgl" Jun 03 20:56:21.785556 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.785417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c46f478-jlbgl" event={"ID":"22effd5b-9535-41fa-9b95-8b8fa137c6ef","Type":"ContainerDied","Data":"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d"} Jun 03 20:56:21.785556 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.785463 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c46f478-jlbgl" event={"ID":"22effd5b-9535-41fa-9b95-8b8fa137c6ef","Type":"ContainerDied","Data":"ace7ad0bd7b93d52b82567b4935dc460f4e26ceadf9c37c31907e782794e2e14"} Jun 03 20:56:21.785556 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.785486 2554 scope.go:117] "RemoveContainer" containerID="8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d" Jun 03 20:56:21.786694 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.786615 2554 generic.go:356] "Generic (PLEG): container finished" podID="a117aa60-c4c6-4419-98c0-6113f5b33458" containerID="03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5" exitCode=0 Jun 03 20:56:21.786694 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.786655 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b9nbq" Jun 03 20:56:21.786790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.786705 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9nbq" event={"ID":"a117aa60-c4c6-4419-98c0-6113f5b33458","Type":"ContainerDied","Data":"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5"} Jun 03 20:56:21.786790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.786744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b9nbq" event={"ID":"a117aa60-c4c6-4419-98c0-6113f5b33458","Type":"ContainerDied","Data":"fb9b77909490f1e8e64be9a1c21c5a28beb76e2813c1a981faa7052ab307ed57"} Jun 03 20:56:21.794511 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.794219 2554 scope.go:117] "RemoveContainer" containerID="8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d" Jun 03 20:56:21.794511 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:56:21.794496 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d\": container with ID starting with 8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d not found: ID does not exist" containerID="8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d" Jun 03 20:56:21.794708 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.794530 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d"} err="failed to get container status \"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d\": rpc error: code = NotFound desc = could not find container \"8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d\": container with ID starting with 8230cf55f5d7e1f2f31d9d8ec3bc2e9dc312a11d42e7eee3f6a486aa7261d21d not found: ID does not exist" Jun 03 20:56:21.794708 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.794554 2554 scope.go:117] "RemoveContainer" containerID="03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5" Jun 03 20:56:21.801837 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.801818 2554 scope.go:117] "RemoveContainer" containerID="03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5" Jun 03 20:56:21.802091 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:56:21.802071 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5\": container with ID starting with 03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5 not found: ID does not exist" containerID="03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5" Jun 03 20:56:21.802149 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.802102 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5"} err="failed to get container status \"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5\": rpc error: code = NotFound desc = could not find container \"03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5\": container with ID starting with 03409f9ff8490876b3723b64ba2f58c9857f2f8f3733e3b24eb13bc1494b09c5 not found: ID does not exist" Jun 03 20:56:21.805991 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.805971 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:21.813530 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.813511 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-869c46f478-jlbgl"] Jun 03 20:56:21.825740 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.825720 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:56:21.830017 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.829998 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b9nbq"] Jun 03 20:56:21.960245 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.960220 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" path="/var/lib/kubelet/pods/22effd5b-9535-41fa-9b95-8b8fa137c6ef/volumes" Jun 03 20:56:21.960534 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:21.960522 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a117aa60-c4c6-4419-98c0-6113f5b33458" path="/var/lib/kubelet/pods/a117aa60-c4c6-4419-98c0-6113f5b33458/volumes" Jun 03 20:56:23.968282 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968252 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968523 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" containerName="authorino" Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968533 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" containerName="authorino" Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968549 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117aa60-c4c6-4419-98c0-6113f5b33458" containerName="authorino" Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968555 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117aa60-c4c6-4419-98c0-6113f5b33458" containerName="authorino" Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968599 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="22effd5b-9535-41fa-9b95-8b8fa137c6ef" containerName="authorino" Jun 03 20:56:23.968634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.968607 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a117aa60-c4c6-4419-98c0-6113f5b33458" containerName="authorino" Jun 03 20:56:23.973080 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.973038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:23.976213 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.976191 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 20:56:23.976347 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.976289 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zm7bf\"" Jun 03 20:56:23.982566 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:23.982542 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:24.108516 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.108479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txg8v\" (UniqueName: \"kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v\") pod \"maas-controller-87f457b58-jvfdf\" (UID: \"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a\") " pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:24.138651 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.138616 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 20:56:24.140816 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.140796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:24.154104 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.154085 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 20:56:24.209563 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.209533 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txg8v\" (UniqueName: \"kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v\") pod \"maas-controller-87f457b58-jvfdf\" (UID: \"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a\") " pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:24.217706 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.217681 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txg8v\" (UniqueName: \"kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v\") pod \"maas-controller-87f457b58-jvfdf\" (UID: \"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a\") " pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:24.284537 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.284461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:24.310964 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.310934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxpm\" (UniqueName: \"kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm\") pod \"maas-controller-69cc7fff55-75k27\" (UID: \"3ce9257d-795e-4624-bc05-47e07466dd38\") " pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:24.411964 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.411932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxpm\" (UniqueName: \"kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm\") pod \"maas-controller-69cc7fff55-75k27\" (UID: \"3ce9257d-795e-4624-bc05-47e07466dd38\") " pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:24.416392 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.416362 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:24.419356 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:56:24.419332 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3e3cf8_9a3e_4449_8a3b_d1d443dfba2a.slice/crio-39a9766f4872d13534b69b7bb3767ef30776e1f2d5a68c0d6aea55eedf4f3f4a WatchSource:0}: Error finding container 39a9766f4872d13534b69b7bb3767ef30776e1f2d5a68c0d6aea55eedf4f3f4a: Status 404 returned error can't find the container with id 39a9766f4872d13534b69b7bb3767ef30776e1f2d5a68c0d6aea55eedf4f3f4a Jun 03 20:56:24.420496 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.420475 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxpm\" (UniqueName: \"kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm\") pod \"maas-controller-69cc7fff55-75k27\" (UID: \"3ce9257d-795e-4624-bc05-47e07466dd38\") " pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:24.450373 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.450348 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:24.574796 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.574738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 20:56:24.577226 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:56:24.577200 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce9257d_795e_4624_bc05_47e07466dd38.slice/crio-12ab0cd4bf9cd326b90de73933f3054509ccbdcc17f11633721ca3121c88d7e9 WatchSource:0}: Error finding container 12ab0cd4bf9cd326b90de73933f3054509ccbdcc17f11633721ca3121c88d7e9: Status 404 returned error can't find the container with id 12ab0cd4bf9cd326b90de73933f3054509ccbdcc17f11633721ca3121c88d7e9 Jun 03 20:56:24.801810 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.801770 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-75k27" event={"ID":"3ce9257d-795e-4624-bc05-47e07466dd38","Type":"ContainerStarted","Data":"12ab0cd4bf9cd326b90de73933f3054509ccbdcc17f11633721ca3121c88d7e9"} Jun 03 20:56:24.802836 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:24.802807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87f457b58-jvfdf" event={"ID":"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a","Type":"ContainerStarted","Data":"39a9766f4872d13534b69b7bb3767ef30776e1f2d5a68c0d6aea55eedf4f3f4a"} Jun 03 20:56:27.207043 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.207012 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:27.327571 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.327535 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:27.823736 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.823696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-75k27" event={"ID":"3ce9257d-795e-4624-bc05-47e07466dd38","Type":"ContainerStarted","Data":"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc"} Jun 03 20:56:27.823944 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.823781 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:27.825278 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.825256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87f457b58-jvfdf" event={"ID":"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a","Type":"ContainerStarted","Data":"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3"} Jun 03 20:56:27.825388 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.825368 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:27.842647 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.842603 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69cc7fff55-75k27" podStartSLOduration=1.44337368 podStartE2EDuration="3.842589435s" totalImagesPullingTime="2.399215755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:27.840745941 +0000 UTC m=+770.294190867" watchObservedRunningTime="2026-06-03 20:56:27.842589435 +0000 UTC m=+770.296034360" Jun 03 20:56:27.870073 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:27.870011 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-87f457b58-jvfdf" podStartSLOduration=2.3219355569999998 podStartE2EDuration="4.869994289s" totalImagesPullingTime="2.548058732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:27.868808971 +0000 UTC m=+770.322253907" watchObservedRunningTime="2026-06-03 20:56:27.869994289 +0000 UTC m=+770.323439205" Jun 03 20:56:38.835219 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:38.835185 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:38.835562 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:38.835339 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 20:56:38.888576 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:38.888542 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:38.888735 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:38.888700 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-87f457b58-jvfdf" podUID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" containerName="manager" containerID="cri-o://7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3" gracePeriod=30 Jun 03 20:56:39.130316 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.130294 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:39.231340 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.231308 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txg8v\" (UniqueName: \"kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v\") pod \"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a\" (UID: \"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a\") " Jun 03 20:56:39.233399 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.233378 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v" (OuterVolumeSpecName: "kube-api-access-txg8v") pod "8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" (UID: "8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a"). InnerVolumeSpecName "kube-api-access-txg8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:39.332010 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.331970 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txg8v\" (UniqueName: \"kubernetes.io/projected/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a-kube-api-access-txg8v\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:56:39.877250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.877218 2554 generic.go:356] "Generic (PLEG): container finished" podID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" containerID="7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3" exitCode=0 Jun 03 20:56:39.877652 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.877275 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87f457b58-jvfdf" Jun 03 20:56:39.877652 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.877316 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87f457b58-jvfdf" event={"ID":"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a","Type":"ContainerDied","Data":"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3"} Jun 03 20:56:39.877652 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.877387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87f457b58-jvfdf" event={"ID":"8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a","Type":"ContainerDied","Data":"39a9766f4872d13534b69b7bb3767ef30776e1f2d5a68c0d6aea55eedf4f3f4a"} Jun 03 20:56:39.877652 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.877410 2554 scope.go:117] "RemoveContainer" containerID="7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3" Jun 03 20:56:39.885446 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.885430 2554 scope.go:117] "RemoveContainer" containerID="7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3" Jun 03 20:56:39.885704 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:56:39.885684 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3\": container with ID starting with 7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3 not found: ID does not exist" containerID="7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3" Jun 03 20:56:39.885748 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.885711 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3"} err="failed to get container status \"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3\": rpc error: code = NotFound desc = could not find container \"7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3\": container with ID starting with 7dd7ce3d48c6c922a51ce7d6dcad5293db563096d09cc22eaaf185df8037e6d3 not found: ID does not exist" Jun 03 20:56:39.901333 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.901309 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:39.910072 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.910052 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-87f457b58-jvfdf"] Jun 03 20:56:39.958647 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:39.958615 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" path="/var/lib/kubelet/pods/8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a/volumes" Jun 03 20:56:42.265127 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:42.265091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:58.242451 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:58.242384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:58.575715 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:58.575689 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:58.689599 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:58.689571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:58.794226 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:56:58.794191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:05.426098 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:05.426052 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j8x5j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 03 20:57:05.426477 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:05.426132 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podUID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 03 20:57:06.994288 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.994254 2554 generic.go:356] "Generic (PLEG): container finished" podID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerID="421fa24852a4e2a0916f63c20a04709b20162267ac9efaa23e82affd7c40f4a1" exitCode=0 Jun 03 20:57:06.994716 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.994327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" event={"ID":"4a88e964-33bd-433d-b151-8e0cd946ff61","Type":"ContainerDied","Data":"421fa24852a4e2a0916f63c20a04709b20162267ac9efaa23e82affd7c40f4a1"} Jun 03 20:57:06.994716 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.994661 2554 scope.go:117] "RemoveContainer" containerID="421fa24852a4e2a0916f63c20a04709b20162267ac9efaa23e82affd7c40f4a1" Jun 03 20:57:06.995630 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.995605 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:57:06.995699 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.995682 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:57:06.995745 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:06.995729 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 20:57:08.000388 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:08.000350 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" event={"ID":"4a88e964-33bd-433d-b151-8e0cd946ff61","Type":"ContainerStarted","Data":"9d839026f37aa937bb78fa4ce52ce8deeefd674f062482365539d00be42d30c4"} Jun 03 20:57:08.161154 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:08.161120 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:57:08.161340 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:08.161318 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j8x5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 03 20:57:08.161436 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:08.161372 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podUID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 03 20:57:09.161261 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:09.161224 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j8x5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 03 20:57:09.161664 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:09.161305 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podUID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 03 20:57:10.161327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:10.161288 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j8x5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 03 20:57:10.161790 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:10.161351 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podUID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 03 20:57:11.162102 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:11.162064 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j8x5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 03 20:57:11.162502 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:11.162139 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" podUID="4a88e964-33bd-433d-b151-8e0cd946ff61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 03 20:57:12.164667 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:12.164638 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:57:12.165145 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:12.165013 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:57:12.165696 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:12.165680 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j8x5j" Jun 03 20:57:39.386001 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:39.385965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:39.442332 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:39.442300 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:48.865058 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.865018 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 20:57:48.865408 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.865314 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" containerName="manager" Jun 03 20:57:48.865408 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.865325 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" containerName="manager" Jun 03 20:57:48.865408 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.865384 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3e3cf8-9a3e-4449-8a3b-d1d443dfba2a" containerName="manager" Jun 03 20:57:48.868331 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.868308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:48.871105 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.871076 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 20:57:48.876759 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.876737 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 20:57:48.922455 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.922426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:48.922595 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.922467 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rvl\" (UniqueName: \"kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:48.922595 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:48.922484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.024459 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.024420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.024617 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.024470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rvl\" (UniqueName: \"kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.024617 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.024487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.025097 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.025072 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.027002 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.026981 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.033672 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.033643 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rvl\" (UniqueName: \"kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl\") pod \"authorino-577fdc4b84-j6vnb\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.178626 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.178556 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 20:57:49.307719 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.307681 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 20:57:49.310974 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:57:49.310948 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c20ce68_e503_479a_a063_e54d62a959dd.slice/crio-6c033a7842b0aaa0cedeb436691bb4b35347b934014abbeaacf85aac893fb319 WatchSource:0}: Error finding container 6c033a7842b0aaa0cedeb436691bb4b35347b934014abbeaacf85aac893fb319: Status 404 returned error can't find the container with id 6c033a7842b0aaa0cedeb436691bb4b35347b934014abbeaacf85aac893fb319 Jun 03 20:57:49.312575 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:49.312559 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:57:50.177966 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.177905 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" event={"ID":"5c20ce68-e503-479a-a063-e54d62a959dd","Type":"ContainerStarted","Data":"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6"} Jun 03 20:57:50.178326 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.177972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" event={"ID":"5c20ce68-e503-479a-a063-e54d62a959dd","Type":"ContainerStarted","Data":"6c033a7842b0aaa0cedeb436691bb4b35347b934014abbeaacf85aac893fb319"} Jun 03 20:57:50.191585 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.191528 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" podStartSLOduration=1.894380639 podStartE2EDuration="2.191508805s" totalImagesPullingTime="297.128166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:50.191185976 +0000 UTC m=+852.644630901" watchObservedRunningTime="2026-06-03 20:57:50.191508805 +0000 UTC m=+852.644953731" Jun 03 20:57:50.223160 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.223125 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:57:50.223345 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.223321 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65b95fc674-5lrsc" podUID="ce20bf2e-b955-4ef2-8305-889723423a02" containerName="authorino" containerID="cri-o://f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53" gracePeriod=30 Jun 03 20:57:50.486104 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.486080 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:57:50.537115 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.537087 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6sr2\" (UniqueName: \"kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2\") pod \"ce20bf2e-b955-4ef2-8305-889723423a02\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " Jun 03 20:57:50.537255 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.537143 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert\") pod \"ce20bf2e-b955-4ef2-8305-889723423a02\" (UID: \"ce20bf2e-b955-4ef2-8305-889723423a02\") " Jun 03 20:57:50.539104 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.539076 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2" (OuterVolumeSpecName: "kube-api-access-f6sr2") pod "ce20bf2e-b955-4ef2-8305-889723423a02" (UID: "ce20bf2e-b955-4ef2-8305-889723423a02"). InnerVolumeSpecName "kube-api-access-f6sr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:57:50.546990 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.546956 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ce20bf2e-b955-4ef2-8305-889723423a02" (UID: "ce20bf2e-b955-4ef2-8305-889723423a02"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:57:50.638614 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.638577 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6sr2\" (UniqueName: \"kubernetes.io/projected/ce20bf2e-b955-4ef2-8305-889723423a02-kube-api-access-f6sr2\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:57:50.638614 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.638613 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce20bf2e-b955-4ef2-8305-889723423a02-tls-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 20:57:50.647344 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.647301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:50.736634 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:50.736540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:51.184655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.184623 2554 generic.go:356] "Generic (PLEG): container finished" podID="ce20bf2e-b955-4ef2-8305-889723423a02" containerID="f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53" exitCode=0 Jun 03 20:57:51.185064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.184670 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b95fc674-5lrsc" Jun 03 20:57:51.185064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.184713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b95fc674-5lrsc" event={"ID":"ce20bf2e-b955-4ef2-8305-889723423a02","Type":"ContainerDied","Data":"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53"} Jun 03 20:57:51.185064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.184756 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b95fc674-5lrsc" event={"ID":"ce20bf2e-b955-4ef2-8305-889723423a02","Type":"ContainerDied","Data":"c64c154bfb221af4871b4c1fcf6e4e128c20bbe3cc4f936e4514f19127061479"} Jun 03 20:57:51.185064 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.184778 2554 scope.go:117] "RemoveContainer" containerID="f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53" Jun 03 20:57:51.193636 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.193621 2554 scope.go:117] "RemoveContainer" containerID="f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53" Jun 03 20:57:51.193889 ip-10-0-128-149 kubenswrapper[2554]: E0603 20:57:51.193872 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53\": container with ID starting with f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53 not found: ID does not exist" containerID="f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53" Jun 03 20:57:51.193974 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.193896 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53"} err="failed to get container status \"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53\": rpc error: code = NotFound desc = could not find container \"f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53\": container with ID starting with f113531ead4e2fe52114f3a663f0e98b9170393c0a8d35c07914ccb0f4f82e53 not found: ID does not exist" Jun 03 20:57:51.207003 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.206979 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:57:51.211078 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.211059 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65b95fc674-5lrsc"] Jun 03 20:57:51.959796 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:57:51.959763 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce20bf2e-b955-4ef2-8305-889723423a02" path="/var/lib/kubelet/pods/ce20bf2e-b955-4ef2-8305-889723423a02/volumes" Jun 03 20:58:07.325778 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.325742 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg"] Jun 03 20:58:07.326253 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.326196 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce20bf2e-b955-4ef2-8305-889723423a02" containerName="authorino" Jun 03 20:58:07.326253 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.326212 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce20bf2e-b955-4ef2-8305-889723423a02" containerName="authorino" Jun 03 20:58:07.326382 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.326311 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce20bf2e-b955-4ef2-8305-889723423a02" containerName="authorino" Jun 03 20:58:07.328837 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.328816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.331307 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.331285 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 20:58:07.331410 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.331343 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 20:58:07.331410 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.331392 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 20:58:07.331488 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.331424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7xf5\"" Jun 03 20:58:07.337795 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.337772 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg"] Jun 03 20:58:07.363896 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.363871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:07.488250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488218 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06dd68a1-f44b-48e1-bb57-eb9027d8f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.488250 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.488452 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.488452 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6672l\" (UniqueName: \"kubernetes.io/projected/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kube-api-access-6672l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.488452 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.488452 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.488437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589234 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06dd68a1-f44b-48e1-bb57-eb9027d8f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589234 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589234 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6672l\" (UniqueName: \"kubernetes.io/projected/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kube-api-access-6672l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589487 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589734 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589711 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589734 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589726 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.589829 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.589764 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.591606 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.591575 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06dd68a1-f44b-48e1-bb57-eb9027d8f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.591901 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.591880 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06dd68a1-f44b-48e1-bb57-eb9027d8f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.596637 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.596614 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6672l\" (UniqueName: \"kubernetes.io/projected/06dd68a1-f44b-48e1-bb57-eb9027d8f121-kube-api-access-6672l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg\" (UID: \"06dd68a1-f44b-48e1-bb57-eb9027d8f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.639609 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.639579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:07.782164 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:07.782138 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg"] Jun 03 20:58:07.784754 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:58:07.784726 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06dd68a1_f44b_48e1_bb57_eb9027d8f121.slice/crio-bbd502e7dc3a76fae3e6aaa9238ae0dee19bf93d85e7a7f939da1212f6bb991a WatchSource:0}: Error finding container bbd502e7dc3a76fae3e6aaa9238ae0dee19bf93d85e7a7f939da1212f6bb991a: Status 404 returned error can't find the container with id bbd502e7dc3a76fae3e6aaa9238ae0dee19bf93d85e7a7f939da1212f6bb991a Jun 03 20:58:08.268252 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:08.268209 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" event={"ID":"06dd68a1-f44b-48e1-bb57-eb9027d8f121","Type":"ContainerStarted","Data":"bbd502e7dc3a76fae3e6aaa9238ae0dee19bf93d85e7a7f939da1212f6bb991a"} Jun 03 20:58:11.283886 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:11.283853 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" event={"ID":"06dd68a1-f44b-48e1-bb57-eb9027d8f121","Type":"ContainerStarted","Data":"5f4b47009c16877bbb68a708dcf92f7fcfb10f0fc509f722834f045fc7866169"} Jun 03 20:58:11.642327 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:11.642289 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:12.295620 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:12.295591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:12.398751 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:12.398717 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:13.294513 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:13.294479 2554 generic.go:356] "Generic (PLEG): container finished" podID="06dd68a1-f44b-48e1-bb57-eb9027d8f121" containerID="5f4b47009c16877bbb68a708dcf92f7fcfb10f0fc509f722834f045fc7866169" exitCode=0 Jun 03 20:58:13.294513 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:13.294516 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" event={"ID":"06dd68a1-f44b-48e1-bb57-eb9027d8f121","Type":"ContainerDied","Data":"5f4b47009c16877bbb68a708dcf92f7fcfb10f0fc509f722834f045fc7866169"} Jun 03 20:58:15.311434 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:15.311387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" event={"ID":"06dd68a1-f44b-48e1-bb57-eb9027d8f121","Type":"ContainerStarted","Data":"f980fa00dbb35f6adc6fe717d423794261a8fb6df3c6591c5b8e965e0dc478ed"} Jun 03 20:58:15.331844 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:15.331792 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" podStartSLOduration=2.728839936 podStartE2EDuration="8.331776606s" totalImagesPullingTime="4.392778874s" totalInitContainerRuntime="1.210157796s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:15.33029646 +0000 UTC m=+877.783741381" watchObservedRunningTime="2026-06-03 20:58:15.331776606 +0000 UTC m=+877.785221531" Jun 03 20:58:17.640580 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:17.640545 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:17.640998 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:17.640604 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:17.653100 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:17.653077 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:18.337027 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:18.337000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg" Jun 03 20:58:23.821766 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.821732 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk"] Jun 03 20:58:23.826143 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.826125 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.828325 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.828305 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 20:58:23.836203 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.836173 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk"] Jun 03 20:58:23.849214 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.849188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:23.930535 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.930690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.930690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.930690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.930690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zplzp\" (UniqueName: \"kubernetes.io/projected/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kube-api-access-zplzp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:23.930833 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:23.930692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031334 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zplzp\" (UniqueName: \"kubernetes.io/projected/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kube-api-access-zplzp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031533 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031533 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031533 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031533 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.031886 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031854 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.032050 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031882 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.032050 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.031963 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.033708 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.033688 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.033875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.033858 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.039331 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.039307 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zplzp\" (UniqueName: \"kubernetes.io/projected/5f36fc7e-0442-4b4f-aaf5-fa02af0ad528-kube-api-access-zplzp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk\" (UID: \"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.158655 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.158568 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:24.292534 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.292504 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk"] Jun 03 20:58:24.294886 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:58:24.294859 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f36fc7e_0442_4b4f_aaf5_fa02af0ad528.slice/crio-782558491b5686cd3349ad79e6a9bab1017c65d66d88d53712ace4c1a002f308 WatchSource:0}: Error finding container 782558491b5686cd3349ad79e6a9bab1017c65d66d88d53712ace4c1a002f308: Status 404 returned error can't find the container with id 782558491b5686cd3349ad79e6a9bab1017c65d66d88d53712ace4c1a002f308 Jun 03 20:58:24.356121 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.356092 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" event={"ID":"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528","Type":"ContainerStarted","Data":"2d60e49cb438d6adc5c1f56b8ec40fcfd9041574d46c999be0145fa27b2f5530"} Jun 03 20:58:24.356221 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:24.356141 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" event={"ID":"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528","Type":"ContainerStarted","Data":"782558491b5686cd3349ad79e6a9bab1017c65d66d88d53712ace4c1a002f308"} Jun 03 20:58:26.367055 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:26.367022 2554 generic.go:356] "Generic (PLEG): container finished" podID="5f36fc7e-0442-4b4f-aaf5-fa02af0ad528" containerID="2d60e49cb438d6adc5c1f56b8ec40fcfd9041574d46c999be0145fa27b2f5530" exitCode=0 Jun 03 20:58:26.367457 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:26.367096 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" event={"ID":"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528","Type":"ContainerDied","Data":"2d60e49cb438d6adc5c1f56b8ec40fcfd9041574d46c999be0145fa27b2f5530"} Jun 03 20:58:27.373075 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:27.373041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" event={"ID":"5f36fc7e-0442-4b4f-aaf5-fa02af0ad528","Type":"ContainerStarted","Data":"501913ac7b6a0ffb2008f5b6c568e0417a9bb088bea6b1e4ebc56db9e9f38631"} Jun 03 20:58:27.392269 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:27.392218 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" podStartSLOduration=2.929804898 podStartE2EDuration="4.392203216s" totalImagesPullingTime="301.481774ms" totalInitContainerRuntime="1.160916544s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:27.391007406 +0000 UTC m=+889.844452332" watchObservedRunningTime="2026-06-03 20:58:27.392203216 +0000 UTC m=+889.845648181" Jun 03 20:58:29.501723 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.501685 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7"] Jun 03 20:58:29.518309 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.518284 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7"] Jun 03 20:58:29.518440 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.518387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.520965 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.520943 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 20:58:29.533883 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.533861 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:29.580021 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.579999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.580131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.580027 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63751864-e9c3-4017-bbc9-8586d265e094-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.580131 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.580073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2t4v\" (UniqueName: \"kubernetes.io/projected/63751864-e9c3-4017-bbc9-8586d265e094-kube-api-access-s2t4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.580249 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.580126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.580249 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.580152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.580249 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.580179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681331 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63751864-e9c3-4017-bbc9-8586d265e094-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681506 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681485 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2t4v\" (UniqueName: \"kubernetes.io/projected/63751864-e9c3-4017-bbc9-8586d265e094-kube-api-access-s2t4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681662 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.681662 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.681553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.682066 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.682034 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.682241 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.682220 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.682415 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.682392 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.683753 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.683730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63751864-e9c3-4017-bbc9-8586d265e094-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.684377 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.684353 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63751864-e9c3-4017-bbc9-8586d265e094-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.691258 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.691236 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2t4v\" (UniqueName: \"kubernetes.io/projected/63751864-e9c3-4017-bbc9-8586d265e094-kube-api-access-s2t4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7\" (UID: \"63751864-e9c3-4017-bbc9-8586d265e094\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.830022 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.829983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:58:29.965293 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:29.965263 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7"] Jun 03 20:58:29.971761 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:58:29.971727 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63751864_e9c3_4017_bbc9_8586d265e094.slice/crio-0845fe55431efcde6c4fee444a323475d84943e37bea43f589412d2eb45e6d21 WatchSource:0}: Error finding container 0845fe55431efcde6c4fee444a323475d84943e37bea43f589412d2eb45e6d21: Status 404 returned error can't find the container with id 0845fe55431efcde6c4fee444a323475d84943e37bea43f589412d2eb45e6d21 Jun 03 20:58:30.388631 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:30.388595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" event={"ID":"63751864-e9c3-4017-bbc9-8586d265e094","Type":"ContainerStarted","Data":"9b66d2d5576b2c36a5a244deacd829a5e2744fcc8b4bc7c242824442d920447b"} Jun 03 20:58:30.388780 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:30.388652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" event={"ID":"63751864-e9c3-4017-bbc9-8586d265e094","Type":"ContainerStarted","Data":"0845fe55431efcde6c4fee444a323475d84943e37bea43f589412d2eb45e6d21"} Jun 03 20:58:30.420223 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:30.420185 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:30.500070 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:30.500042 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:34.158744 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:34.158712 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:34.159317 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:34.158772 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:34.171298 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:34.171271 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:34.417715 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:34.417626 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk" Jun 03 20:58:38.419909 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.419861 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg"] Jun 03 20:58:38.423204 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.423183 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.425337 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.425314 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 20:58:38.436349 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.436326 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg"] Jun 03 20:58:38.503391 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.503364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:38.563690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563654 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphff\" (UniqueName: \"kubernetes.io/projected/290a4591-7693-4815-b375-8c5b5fff8d90-kube-api-access-hphff\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.563690 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.563875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.563875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290a4591-7693-4815-b375-8c5b5fff8d90-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.563875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.563875 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.563853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664448 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphff\" (UniqueName: \"kubernetes.io/projected/290a4591-7693-4815-b375-8c5b5fff8d90-kube-api-access-hphff\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664448 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664680 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664680 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290a4591-7693-4815-b375-8c5b5fff8d90-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664680 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664680 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664857 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664835 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.664906 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664886 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.665002 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.664984 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.666882 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.666863 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290a4591-7693-4815-b375-8c5b5fff8d90-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.667060 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.667045 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290a4591-7693-4815-b375-8c5b5fff8d90-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.671833 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.671779 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphff\" (UniqueName: \"kubernetes.io/projected/290a4591-7693-4815-b375-8c5b5fff8d90-kube-api-access-hphff\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg\" (UID: \"290a4591-7693-4815-b375-8c5b5fff8d90\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.733768 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.733726 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:38.870754 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.870727 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg"] Jun 03 20:58:38.872510 ip-10-0-128-149 kubenswrapper[2554]: W0603 20:58:38.872476 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290a4591_7693_4815_b375_8c5b5fff8d90.slice/crio-25b09112537f8a2e95aa304563c063d7dc462a35738b29d8ceb75f441986c638 WatchSource:0}: Error finding container 25b09112537f8a2e95aa304563c063d7dc462a35738b29d8ceb75f441986c638: Status 404 returned error can't find the container with id 25b09112537f8a2e95aa304563c063d7dc462a35738b29d8ceb75f441986c638 Jun 03 20:58:38.978377 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:38.978345 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:39.430237 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:39.430201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" event={"ID":"290a4591-7693-4815-b375-8c5b5fff8d90","Type":"ContainerStarted","Data":"89a2dcf8a2e44b64b6d6d3b81241ac3b9e0bddb9cf27b8138461e2222dcbe65f"} Jun 03 20:58:39.430696 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:39.430262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" event={"ID":"290a4591-7693-4815-b375-8c5b5fff8d90","Type":"ContainerStarted","Data":"25b09112537f8a2e95aa304563c063d7dc462a35738b29d8ceb75f441986c638"} Jun 03 20:58:40.256442 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:40.256399 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:40.437878 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:40.437787 2554 generic.go:356] "Generic (PLEG): container finished" podID="290a4591-7693-4815-b375-8c5b5fff8d90" containerID="89a2dcf8a2e44b64b6d6d3b81241ac3b9e0bddb9cf27b8138461e2222dcbe65f" exitCode=0 Jun 03 20:58:40.437878 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:40.437835 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" event={"ID":"290a4591-7693-4815-b375-8c5b5fff8d90","Type":"ContainerDied","Data":"89a2dcf8a2e44b64b6d6d3b81241ac3b9e0bddb9cf27b8138461e2222dcbe65f"} Jun 03 20:58:41.443987 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:41.443942 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" event={"ID":"290a4591-7693-4815-b375-8c5b5fff8d90","Type":"ContainerStarted","Data":"2d34245968ee1feba0aecc79c61f63a394b7ce00be3df9706c1fa1b14746d83f"} Jun 03 20:58:41.461692 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:41.461635 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" podStartSLOduration=2.063166434 podStartE2EDuration="3.461619202s" totalImagesPullingTime="203.117112ms" totalInitContainerRuntime="1.195335656s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:41.460643944 +0000 UTC m=+903.914088869" watchObservedRunningTime="2026-06-03 20:58:41.461619202 +0000 UTC m=+903.915064126" Jun 03 20:58:48.734623 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:48.734589 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:48.735019 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:48.734648 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:48.747260 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:48.747233 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:49.491103 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:49.491078 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg" Jun 03 20:58:53.946360 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:58:53.946328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:59:24.639791 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:24.639753 2554 generic.go:356] "Generic (PLEG): container finished" podID="63751864-e9c3-4017-bbc9-8586d265e094" containerID="9b66d2d5576b2c36a5a244deacd829a5e2744fcc8b4bc7c242824442d920447b" exitCode=0 Jun 03 20:59:24.640238 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:24.639825 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" event={"ID":"63751864-e9c3-4017-bbc9-8586d265e094","Type":"ContainerDied","Data":"9b66d2d5576b2c36a5a244deacd829a5e2744fcc8b4bc7c242824442d920447b"} Jun 03 20:59:25.645640 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:25.645606 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" event={"ID":"63751864-e9c3-4017-bbc9-8586d265e094","Type":"ContainerStarted","Data":"500d0207f9af9442e21541acab70c894eb741aaee9c93f0a0b02810cb67f4605"} Jun 03 20:59:25.666002 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:25.665960 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" podStartSLOduration=2.418782919 podStartE2EDuration="56.665944311s" totalImagesPullingTime="205.953964ms" totalInitContainerRuntime="54.041207428s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:59:25.663892228 +0000 UTC m=+948.117337153" watchObservedRunningTime="2026-06-03 20:59:25.665944311 +0000 UTC m=+948.119389237" Jun 03 20:59:29.830490 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:29.830461 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:59:29.830982 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:29.830518 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:59:29.843344 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:29.843321 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:59:30.680668 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:30.680638 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7" Jun 03 20:59:59.864315 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:59.864199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 20:59:59.958520 ip-10-0-128-149 kubenswrapper[2554]: I0603 20:59:59.958479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:00.455940 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.455888 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 21:00:00.456131 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.456108 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" podUID="5c20ce68-e503-479a-a063-e54d62a959dd" containerName="authorino" containerID="cri-o://95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6" gracePeriod=30 Jun 03 21:00:00.711337 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.711280 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 21:00:00.790727 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.790697 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert\") pod \"5c20ce68-e503-479a-a063-e54d62a959dd\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " Jun 03 21:00:00.790905 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.790776 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5rvl\" (UniqueName: \"kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl\") pod \"5c20ce68-e503-479a-a063-e54d62a959dd\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " Jun 03 21:00:00.790905 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.790850 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca\") pod \"5c20ce68-e503-479a-a063-e54d62a959dd\" (UID: \"5c20ce68-e503-479a-a063-e54d62a959dd\") " Jun 03 21:00:00.792789 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.792755 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl" (OuterVolumeSpecName: "kube-api-access-w5rvl") pod "5c20ce68-e503-479a-a063-e54d62a959dd" (UID: "5c20ce68-e503-479a-a063-e54d62a959dd"). InnerVolumeSpecName "kube-api-access-w5rvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:00:00.795202 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.795176 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "5c20ce68-e503-479a-a063-e54d62a959dd" (UID: "5c20ce68-e503-479a-a063-e54d62a959dd"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:00:00.799864 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.799840 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5c20ce68-e503-479a-a063-e54d62a959dd" (UID: "5c20ce68-e503-479a-a063-e54d62a959dd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:00:00.803954 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.803926 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c20ce68-e503-479a-a063-e54d62a959dd" containerID="95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6" exitCode=0 Jun 03 21:00:00.804098 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.804015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" event={"ID":"5c20ce68-e503-479a-a063-e54d62a959dd","Type":"ContainerDied","Data":"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6"} Jun 03 21:00:00.804098 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.804068 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" Jun 03 21:00:00.804098 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.804086 2554 scope.go:117] "RemoveContainer" containerID="95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6" Jun 03 21:00:00.804256 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.804072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577fdc4b84-j6vnb" event={"ID":"5c20ce68-e503-479a-a063-e54d62a959dd","Type":"ContainerDied","Data":"6c033a7842b0aaa0cedeb436691bb4b35347b934014abbeaacf85aac893fb319"} Jun 03 21:00:00.815905 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.815883 2554 scope.go:117] "RemoveContainer" containerID="95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6" Jun 03 21:00:00.816193 ip-10-0-128-149 kubenswrapper[2554]: E0603 21:00:00.816170 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6\": container with ID starting with 95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6 not found: ID does not exist" containerID="95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6" Jun 03 21:00:00.816299 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.816199 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6"} err="failed to get container status \"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6\": rpc error: code = NotFound desc = could not find container \"95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6\": container with ID starting with 95e8e56177df4c1f61889f1ff10cb177aa848c67e978f8329064c0c77e75fcf6 not found: ID does not exist" Jun 03 21:00:00.832837 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.832813 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 21:00:00.837263 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.837239 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-577fdc4b84-j6vnb"] Jun 03 21:00:00.892024 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.891998 2554 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5c20ce68-e503-479a-a063-e54d62a959dd-oidc-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:00:00.892024 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.892025 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c20ce68-e503-479a-a063-e54d62a959dd-tls-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:00:00.892399 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.892039 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5rvl\" (UniqueName: \"kubernetes.io/projected/5c20ce68-e503-479a-a063-e54d62a959dd-kube-api-access-w5rvl\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:00:00.920692 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:00.920657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:01.008851 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:01.008757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:01.959435 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:01.959400 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c20ce68-e503-479a-a063-e54d62a959dd" path="/var/lib/kubelet/pods/5c20ce68-e503-479a-a063-e54d62a959dd/volumes" Jun 03 21:00:40.132805 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:40.132762 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:40.234097 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:00:40.234059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:01:26.084534 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.084492 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 21:01:26.085025 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.084686 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69cc7fff55-75k27" podUID="3ce9257d-795e-4624-bc05-47e07466dd38" containerName="manager" containerID="cri-o://2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc" gracePeriod=30 Jun 03 21:01:26.340986 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.340929 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 21:01:26.453521 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.453483 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxpm\" (UniqueName: \"kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm\") pod \"3ce9257d-795e-4624-bc05-47e07466dd38\" (UID: \"3ce9257d-795e-4624-bc05-47e07466dd38\") " Jun 03 21:01:26.455533 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.455505 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm" (OuterVolumeSpecName: "kube-api-access-6vxpm") pod "3ce9257d-795e-4624-bc05-47e07466dd38" (UID: "3ce9257d-795e-4624-bc05-47e07466dd38"). InnerVolumeSpecName "kube-api-access-6vxpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:01:26.555079 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:26.555050 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxpm\" (UniqueName: \"kubernetes.io/projected/3ce9257d-795e-4624-bc05-47e07466dd38-kube-api-access-6vxpm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:01:27.198850 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.198807 2554 generic.go:356] "Generic (PLEG): container finished" podID="3ce9257d-795e-4624-bc05-47e07466dd38" containerID="2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc" exitCode=0 Jun 03 21:01:27.199312 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.198867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-75k27" event={"ID":"3ce9257d-795e-4624-bc05-47e07466dd38","Type":"ContainerDied","Data":"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc"} Jun 03 21:01:27.199312 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.198872 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-75k27" Jun 03 21:01:27.199312 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.198908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-75k27" event={"ID":"3ce9257d-795e-4624-bc05-47e07466dd38","Type":"ContainerDied","Data":"12ab0cd4bf9cd326b90de73933f3054509ccbdcc17f11633721ca3121c88d7e9"} Jun 03 21:01:27.199312 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.198952 2554 scope.go:117] "RemoveContainer" containerID="2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc" Jun 03 21:01:27.208240 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.208224 2554 scope.go:117] "RemoveContainer" containerID="2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc" Jun 03 21:01:27.208471 ip-10-0-128-149 kubenswrapper[2554]: E0603 21:01:27.208453 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc\": container with ID starting with 2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc not found: ID does not exist" containerID="2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc" Jun 03 21:01:27.208541 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.208476 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc"} err="failed to get container status \"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc\": rpc error: code = NotFound desc = could not find container \"2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc\": container with ID starting with 2cf2d888b1c129906a1ef438519588e6c9ae8fcee6dfbe464cd14e47a93283fc not found: ID does not exist" Jun 03 21:01:27.221503 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.221481 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 21:01:27.226120 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.226097 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-75k27"] Jun 03 21:01:27.951263 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951182 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69cc7fff55-nkmcc"] Jun 03 21:01:27.951508 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951495 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce9257d-795e-4624-bc05-47e07466dd38" containerName="manager" Jun 03 21:01:27.951556 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951509 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce9257d-795e-4624-bc05-47e07466dd38" containerName="manager" Jun 03 21:01:27.951556 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951524 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c20ce68-e503-479a-a063-e54d62a959dd" containerName="authorino" Jun 03 21:01:27.951556 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951530 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c20ce68-e503-479a-a063-e54d62a959dd" containerName="authorino" Jun 03 21:01:27.951812 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951593 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c20ce68-e503-479a-a063-e54d62a959dd" containerName="authorino" Jun 03 21:01:27.951812 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.951602 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce9257d-795e-4624-bc05-47e07466dd38" containerName="manager" Jun 03 21:01:27.955821 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.955794 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:27.957675 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.957649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 21:01:27.957675 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.957663 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zm7bf\"" Jun 03 21:01:27.962250 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.962227 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce9257d-795e-4624-bc05-47e07466dd38" path="/var/lib/kubelet/pods/3ce9257d-795e-4624-bc05-47e07466dd38/volumes" Jun 03 21:01:27.962537 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:27.962521 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-nkmcc"] Jun 03 21:01:28.069611 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:28.069574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6v6g\" (UniqueName: \"kubernetes.io/projected/323cdd65-4514-46ef-a75f-f74505229f6d-kube-api-access-m6v6g\") pod \"maas-controller-69cc7fff55-nkmcc\" (UID: \"323cdd65-4514-46ef-a75f-f74505229f6d\") " pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:28.170429 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:28.170391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6v6g\" (UniqueName: \"kubernetes.io/projected/323cdd65-4514-46ef-a75f-f74505229f6d-kube-api-access-m6v6g\") pod \"maas-controller-69cc7fff55-nkmcc\" (UID: \"323cdd65-4514-46ef-a75f-f74505229f6d\") " pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:28.178630 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:28.178601 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6v6g\" (UniqueName: \"kubernetes.io/projected/323cdd65-4514-46ef-a75f-f74505229f6d-kube-api-access-m6v6g\") pod \"maas-controller-69cc7fff55-nkmcc\" (UID: \"323cdd65-4514-46ef-a75f-f74505229f6d\") " pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:28.267813 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:28.267736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:28.396992 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:28.396965 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cc7fff55-nkmcc"] Jun 03 21:01:28.399622 ip-10-0-128-149 kubenswrapper[2554]: W0603 21:01:28.399598 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323cdd65_4514_46ef_a75f_f74505229f6d.slice/crio-ed2f7af7fb3ef59c0401482481f53f994fc72a4876251a9007afe376511dec0e WatchSource:0}: Error finding container ed2f7af7fb3ef59c0401482481f53f994fc72a4876251a9007afe376511dec0e: Status 404 returned error can't find the container with id ed2f7af7fb3ef59c0401482481f53f994fc72a4876251a9007afe376511dec0e Jun 03 21:01:29.209888 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:29.209856 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" event={"ID":"323cdd65-4514-46ef-a75f-f74505229f6d","Type":"ContainerStarted","Data":"e6d3029ed07249964de2bd6bcfac85b1a21f7bb7ed7262ca5845c601373cfcf0"} Jun 03 21:01:29.210075 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:29.209904 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" event={"ID":"323cdd65-4514-46ef-a75f-f74505229f6d","Type":"ContainerStarted","Data":"ed2f7af7fb3ef59c0401482481f53f994fc72a4876251a9007afe376511dec0e"} Jun 03 21:01:29.210075 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:29.210000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:01:29.225895 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:29.225767 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" podStartSLOduration=1.830996357 podStartE2EDuration="2.22575053s" totalImagesPullingTime="394.754173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:01:29.225604316 +0000 UTC m=+1071.679049244" watchObservedRunningTime="2026-06-03 21:01:29.22575053 +0000 UTC m=+1071.679195459" Jun 03 21:01:40.221697 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:01:40.221664 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69cc7fff55-nkmcc" Jun 03 21:02:07.579847 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:07.579813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:07.676445 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:07.676410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:15.953401 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:15.953361 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:21.790181 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:21.790144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:21.890352 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:21.890319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:53.901481 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:53.901432 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:53.991425 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:02:53.991388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:17.683337 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:17.683303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:24.042574 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:24.042523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:24.145494 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:24.145455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:24.244685 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:24.244654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:24.409731 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:24.409697 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:24.509909 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:24.509867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:40.928831 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:40.928778 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:41.968910 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:41.968865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:47.247243 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:47.247192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:47.342884 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:47.342843 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:55.384749 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:55.384713 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:55.482515 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:55.482483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:55.586397 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:55.586356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:55.685569 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:03:55.685478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:12.063106 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:04:12.063063 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:12.174619 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:04:12.174586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:12.280175 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:04:12.280137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:18.155308 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:04:18.155276 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:18.255329 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:04:18.255300 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:05:41.498840 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:05:41.498809 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:08:18.445972 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:08:18.445910 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:08:18.527932 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:08:18.527882 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:09:32.194180 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:09:32.194128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:09:33.313068 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:09:33.313009 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:11:48.078555 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.078515 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 21:11:48.079115 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.078714 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" podUID="0479ffea-8f65-4916-b40a-1ba00b0645e5" containerName="manager" containerID="cri-o://8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01" gracePeriod=10 Jun 03 21:11:48.441462 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.441435 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 21:11:48.499388 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.499347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn5xb\" (UniqueName: \"kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb\") pod \"0479ffea-8f65-4916-b40a-1ba00b0645e5\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " Jun 03 21:11:48.499551 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.499408 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume\") pod \"0479ffea-8f65-4916-b40a-1ba00b0645e5\" (UID: \"0479ffea-8f65-4916-b40a-1ba00b0645e5\") " Jun 03 21:11:48.499800 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.499773 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0479ffea-8f65-4916-b40a-1ba00b0645e5" (UID: "0479ffea-8f65-4916-b40a-1ba00b0645e5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:11:48.501423 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.501402 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb" (OuterVolumeSpecName: "kube-api-access-jn5xb") pod "0479ffea-8f65-4916-b40a-1ba00b0645e5" (UID: "0479ffea-8f65-4916-b40a-1ba00b0645e5"). InnerVolumeSpecName "kube-api-access-jn5xb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:11:48.600520 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.600490 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn5xb\" (UniqueName: \"kubernetes.io/projected/0479ffea-8f65-4916-b40a-1ba00b0645e5-kube-api-access-jn5xb\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:11:48.600520 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:48.600517 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0479ffea-8f65-4916-b40a-1ba00b0645e5-extensions-socket-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\"" Jun 03 21:11:49.068538 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.068496 2554 generic.go:356] "Generic (PLEG): container finished" podID="0479ffea-8f65-4916-b40a-1ba00b0645e5" containerID="8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01" exitCode=0 Jun 03 21:11:49.068708 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.068548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" event={"ID":"0479ffea-8f65-4916-b40a-1ba00b0645e5","Type":"ContainerDied","Data":"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01"} Jun 03 21:11:49.068708 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.068606 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" event={"ID":"0479ffea-8f65-4916-b40a-1ba00b0645e5","Type":"ContainerDied","Data":"eb8e02a750a132fcf1947fd26ee522f41839738092df6d7b994f774dfb5b4eb9"} Jun 03 21:11:49.068708 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.068628 2554 scope.go:117] "RemoveContainer" containerID="8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01" Jun 03 21:11:49.068708 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.068561 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86" Jun 03 21:11:49.078541 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.078521 2554 scope.go:117] "RemoveContainer" containerID="8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01" Jun 03 21:11:49.078776 ip-10-0-128-149 kubenswrapper[2554]: E0603 21:11:49.078758 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01\": container with ID starting with 8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01 not found: ID does not exist" containerID="8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01" Jun 03 21:11:49.079078 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.078794 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01"} err="failed to get container status \"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01\": rpc error: code = NotFound desc = could not find container \"8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01\": container with ID starting with 8bfaa7b267596575d9435fc7433e4adacffb28c6818d2cf04ba22c3345db9a01 not found: ID does not exist" Jun 03 21:11:49.090812 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.090777 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 21:11:49.095819 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.095796 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkt86"] Jun 03 21:11:49.959955 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:11:49.959898 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0479ffea-8f65-4916-b40a-1ba00b0645e5" path="/var/lib/kubelet/pods/0479ffea-8f65-4916-b40a-1ba00b0645e5/volumes" Jun 03 21:12:54.171393 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.171357 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8"] Jun 03 21:12:54.171824 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.171659 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0479ffea-8f65-4916-b40a-1ba00b0645e5" containerName="manager" Jun 03 21:12:54.171824 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.171670 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0479ffea-8f65-4916-b40a-1ba00b0645e5" containerName="manager" Jun 03 21:12:54.171824 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.171769 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0479ffea-8f65-4916-b40a-1ba00b0645e5" containerName="manager" Jun 03 21:12:54.175034 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.175017 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.177316 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.177289 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-66zz9\"" Jun 03 21:12:54.189053 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.189028 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8"] Jun 03 21:12:54.256039 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.256009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76787827-7948-4ef9-9b2f-682a40f7ec6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.256202 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.256105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bld\" (UniqueName: \"kubernetes.io/projected/76787827-7948-4ef9-9b2f-682a40f7ec6c-kube-api-access-55bld\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.356832 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.356801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55bld\" (UniqueName: \"kubernetes.io/projected/76787827-7948-4ef9-9b2f-682a40f7ec6c-kube-api-access-55bld\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.357020 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.356867 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76787827-7948-4ef9-9b2f-682a40f7ec6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.357202 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.357184 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76787827-7948-4ef9-9b2f-682a40f7ec6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.367421 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.367400 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bld\" (UniqueName: \"kubernetes.io/projected/76787827-7948-4ef9-9b2f-682a40f7ec6c-kube-api-access-55bld\") pod \"kuadrant-operator-controller-manager-86878c769f-blsr8\" (UID: \"76787827-7948-4ef9-9b2f-682a40f7ec6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.484746 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.484661 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:12:54.624219 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:54.624195 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8"] Jun 03 21:12:54.630782 ip-10-0-128-149 kubenswrapper[2554]: W0603 21:12:54.627610 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76787827_7948_4ef9_9b2f_682a40f7ec6c.slice/crio-c3591420487f7983343ca9257358dd3ead1f0f69837282ebe8ed97ca209eaf7a WatchSource:0}: Error finding container c3591420487f7983343ca9257358dd3ead1f0f69837282ebe8ed97ca209eaf7a: Status 404 returned error can't find the container with id c3591420487f7983343ca9257358dd3ead1f0f69837282ebe8ed97ca209eaf7a Jun 03 21:12:55.362454 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:55.362415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" event={"ID":"76787827-7948-4ef9-9b2f-682a40f7ec6c","Type":"ContainerStarted","Data":"d53b9c1933c6a04d6dc4259dc27a0bb58ffa2bb03ffffff9e84fff81706484e1"} Jun 03 21:12:55.362876 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:55.362516 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" event={"ID":"76787827-7948-4ef9-9b2f-682a40f7ec6c","Type":"ContainerStarted","Data":"c3591420487f7983343ca9257358dd3ead1f0f69837282ebe8ed97ca209eaf7a"} Jun 03 21:12:55.362876 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:12:55.362549 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:13:06.369870 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:13:06.369836 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" Jun 03 21:13:06.388967 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:13:06.388881 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-blsr8" podStartSLOduration=12.388865533 podStartE2EDuration="12.388865533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:55.412047195 +0000 UTC m=+1757.865492120" watchObservedRunningTime="2026-06-03 21:13:06.388865533 +0000 UTC m=+1768.842310515" Jun 03 21:13:18.369777 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:13:18.369730 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:13:18.455953 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:13:18.455814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:15:34.458994 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:15:34.458959 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:16:20.126850 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:16:20.126814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:16:20.228073 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:16:20.228026 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:01.684692 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:22:01.684647 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:11.201006 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:22:11.200973 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:35.478179 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:22:35.478100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:48.477728 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:22:48.477689 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:00.438348 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:00.438292 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dd8b9685-xrjks_d12956e2-4fcc-4df0-9d65-75e82c0b0449/nginx/0.log" Jun 03 21:23:01.205391 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:01.205357 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69cc7fff55-nkmcc_323cdd65-4514-46ef-a75f-f74505229f6d/manager/0.log" Jun 03 21:23:01.583830 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:01.583806 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-6gbh9_0283981f-904c-4fb6-9dc1-b6cf7c2eff5f/copy-manifests/0.log" Jun 03 21:23:01.606999 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:01.606973 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-6gbh9_0283981f-904c-4fb6-9dc1-b6cf7c2eff5f/manager/0.log" Jun 03 21:23:03.612543 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:03.612514 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ppchn_e8c71b32-1548-4856-b242-1e9c4f0a7e6b/manager/0.log" Jun 03 21:23:03.722891 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:03.722859 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-48tl5_c2dcfab0-b556-4ee3-83f5-b4e5a1fab254/kuadrant-console-plugin/0.log" Jun 03 21:23:03.844924 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:03.844880 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kzd88_f8502c2e-5974-4ccd-9caf-66010eec29bd/registry-server/0.log" Jun 03 21:23:03.962409 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:03.962336 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-blsr8_76787827-7948-4ef9-9b2f-682a40f7ec6c/manager/0.log" Jun 03 21:23:04.196704 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:04.196674 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tsmbs_fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f/manager/0.log" Jun 03 21:23:04.546157 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:04.546129 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795g6s2f_bb122fba-c067-4f0c-bfd1-9357ea01e4ef/istio-proxy/0.log" Jun 03 21:23:05.026998 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:05.026965 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/1.log" Jun 03 21:23:05.739498 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:05.739463 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg_06dd68a1-f44b-48e1-bb57-eb9027d8f121/storage-initializer/0.log" Jun 03 21:23:05.747699 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:05.747671 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g42mg_06dd68a1-f44b-48e1-bb57-eb9027d8f121/main/0.log" Jun 03 21:23:05.987952 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:05.987904 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk_5f36fc7e-0442-4b4f-aaf5-fa02af0ad528/storage-initializer/0.log" Jun 03 21:23:05.999436 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:05.999362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gbcnk_5f36fc7e-0442-4b4f-aaf5-fa02af0ad528/main/0.log" Jun 03 21:23:06.110742 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:06.110703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7_63751864-e9c3-4017-bbc9-8586d265e094/storage-initializer/0.log" Jun 03 21:23:06.125464 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:06.125438 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4vsf7_63751864-e9c3-4017-bbc9-8586d265e094/main/0.log" Jun 03 21:23:06.237995 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:06.237969 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg_290a4591-7693-4815-b375-8c5b5fff8d90/storage-initializer/0.log" Jun 03 21:23:06.246803 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:06.246783 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w4bbg_290a4591-7693-4815-b375-8c5b5fff8d90/main/0.log" Jun 03 21:23:10.252071 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:10.252038 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:10.330030 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:10.329999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:13.367979 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:13.367946 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jwdsl_ff4710bf-8cde-4917-8db9-29e35c12d574/global-pull-secret-syncer/0.log" Jun 03 21:23:13.470113 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:13.470082 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9tsbg_b391488a-1b65-4db1-8e08-dd002ab4544c/konnectivity-agent/0.log" Jun 03 21:23:13.578639 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:13.578613 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-149.ec2.internal_11f9974b03393a4242e374df7239145d/haproxy/0.log" Jun 03 21:23:19.464678 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:19.464646 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ppchn_e8c71b32-1548-4856-b242-1e9c4f0a7e6b/manager/0.log" Jun 03 21:23:19.501260 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:19.501227 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-48tl5_c2dcfab0-b556-4ee3-83f5-b4e5a1fab254/kuadrant-console-plugin/0.log" Jun 03 21:23:19.554547 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:19.554515 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kzd88_f8502c2e-5974-4ccd-9caf-66010eec29bd/registry-server/0.log" Jun 03 21:23:19.624409 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:19.624377 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-blsr8_76787827-7948-4ef9-9b2f-682a40f7ec6c/manager/0.log" Jun 03 21:23:19.711099 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:19.711068 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tsmbs_fd14a7b7-637a-4ddf-bca8-6d3201dc1a3f/manager/0.log" Jun 03 21:23:21.720272 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:21.720235 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5974fdc55-x68gs_c65cee4c-00ec-46cb-aeea-18e8ae18fb70/metrics-server/0.log" Jun 03 21:23:21.973564 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:21.973478 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnwxg_535f4c50-c0c0-4de7-a442-655b5d676392/node-exporter/0.log" Jun 03 21:23:22.004762 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:22.004739 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnwxg_535f4c50-c0c0-4de7-a442-655b5d676392/kube-rbac-proxy/0.log" Jun 03 21:23:22.046543 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:22.046514 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnwxg_535f4c50-c0c0-4de7-a442-655b5d676392/init-textfile/0.log" Jun 03 21:23:25.614626 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.614588 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7"] Jun 03 21:23:25.618233 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.618207 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.623092 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.623060 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjqlg\"/\"default-dockercfg-jwvcn\"" Jun 03 21:23:25.623199 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.623066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"openshift-service-ca.crt\"" Jun 03 21:23:25.623517 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.623504 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"kube-root-ca.crt\"" Jun 03 21:23:25.633631 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.633609 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7"] Jun 03 21:23:25.707820 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.707786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-proc\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.707980 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.707848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-podres\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.707980 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.707872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxnz\" (UniqueName: \"kubernetes.io/projected/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-kube-api-access-kpxnz\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.707980 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.707897 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-sys\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.708089 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.707993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-lib-modules\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809169 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-podres\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809169 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809167 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxnz\" (UniqueName: \"kubernetes.io/projected/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-kube-api-access-kpxnz\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809372 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-sys\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809372 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-lib-modules\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809372 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-proc\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809372 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809285 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-sys\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809372 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809347 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-proc\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809548 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809384 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-podres\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.809548 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.809398 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-lib-modules\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.817458 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.817430 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxnz\" (UniqueName: \"kubernetes.io/projected/b8b44f91-e8e6-4c45-9e91-f823a7e8157a-kube-api-access-kpxnz\") pod \"perf-node-gather-daemonset-gd4l7\" (UID: \"b8b44f91-e8e6-4c45-9e91-f823a7e8157a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:25.929055 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:25.928869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:26.061147 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:26.061114 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7"] Jun 03 21:23:26.065511 ip-10-0-128-149 kubenswrapper[2554]: W0603 21:23:26.065482 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8b44f91_e8e6_4c45_9e91_f823a7e8157a.slice/crio-e15b5781c2928a315fb9687ca22de0d64976ce2b0527b64b8a9a031295fd567c WatchSource:0}: Error finding container e15b5781c2928a315fb9687ca22de0d64976ce2b0527b64b8a9a031295fd567c: Status 404 returned error can't find the container with id e15b5781c2928a315fb9687ca22de0d64976ce2b0527b64b8a9a031295fd567c Jun 03 21:23:26.168024 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:26.167997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" event={"ID":"b8b44f91-e8e6-4c45-9e91-f823a7e8157a","Type":"ContainerStarted","Data":"38de51c8d43c67fb11544e8f94c79fbb8f0772a90c087268e3190248ddf9fbb7"} Jun 03 21:23:26.168156 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:26.168053 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" event={"ID":"b8b44f91-e8e6-4c45-9e91-f823a7e8157a","Type":"ContainerStarted","Data":"e15b5781c2928a315fb9687ca22de0d64976ce2b0527b64b8a9a031295fd567c"} Jun 03 21:23:26.168156 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:26.168113 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:26.185434 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:26.185356 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" podStartSLOduration=1.1853435270000001 podStartE2EDuration="1.185343527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:26.184192023 +0000 UTC m=+2388.637636949" watchObservedRunningTime="2026-06-03 21:23:26.185343527 +0000 UTC m=+2388.638788451" Jun 03 21:23:27.332393 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:27.332364 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2kwnw_5fd35282-301b-4a08-b1ad-b3ccd9abbdb3/dns/0.log" Jun 03 21:23:27.354241 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:27.354213 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2kwnw_5fd35282-301b-4a08-b1ad-b3ccd9abbdb3/kube-rbac-proxy/0.log" Jun 03 21:23:27.539519 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:27.539491 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vstwg_fdbd75ac-7c83-42c6-8d22-95cef227c93e/dns-node-resolver/0.log" Jun 03 21:23:28.087331 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:28.087299 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6964d49d65-g7zcb_cd7d499e-5b34-4dea-82d8-07ce00358b76/registry/0.log" Jun 03 21:23:28.094618 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:28.094595 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6964d49d65-g7zcb_cd7d499e-5b34-4dea-82d8-07ce00358b76/registry/1.log" Jun 03 21:23:28.170735 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:28.170703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xgt7r_73b5fab7-1a3f-4e57-84a3-58d1b7340f23/node-ca/0.log" Jun 03 21:23:29.149376 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:29.149344 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795g6s2f_bb122fba-c067-4f0c-bfd1-9357ea01e4ef/istio-proxy/0.log" Jun 03 21:23:29.386473 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:29.386425 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/0.log" Jun 03 21:23:29.418950 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:29.418860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/1.log" Jun 03 21:23:30.312791 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:30.312766 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrr98_9998b060-f5ec-4918-a2d9-7cefc8cd4d3f/serve-healthcheck-canary/0.log" Jun 03 21:23:30.970257 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:30.970230 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjdjb_11b83167-25be-4b9a-a9dc-e935e1507441/kube-rbac-proxy/0.log" Jun 03 21:23:30.991857 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:30.991834 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjdjb_11b83167-25be-4b9a-a9dc-e935e1507441/exporter/0.log" Jun 03 21:23:31.016879 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:31.016855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjdjb_11b83167-25be-4b9a-a9dc-e935e1507441/extractor/0.log" Jun 03 21:23:32.182334 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:32.182308 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-gd4l7" Jun 03 21:23:33.357224 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:33.357188 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dd8b9685-xrjks_d12956e2-4fcc-4df0-9d65-75e82c0b0449/nginx/0.log" Jun 03 21:23:33.711083 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:33.710972 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69cc7fff55-nkmcc_323cdd65-4514-46ef-a75f-f74505229f6d/manager/0.log" Jun 03 21:23:33.920573 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:33.920537 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-6gbh9_0283981f-904c-4fb6-9dc1-b6cf7c2eff5f/manager/0.log" Jun 03 21:23:33.941010 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:33.940983 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-6gbh9_0283981f-904c-4fb6-9dc1-b6cf7c2eff5f/copy-manifests/0.log" Jun 03 21:23:35.909685 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:35.909596 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79d7d4f4f7-7f72w_df02a95a-3f8c-420d-bb42-e3b8ce399982/manager/0.log" Jun 03 21:23:39.066708 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:39.066678 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795g6s2f_bb122fba-c067-4f0c-bfd1-9357ea01e4ef/istio-proxy/0.log" Jun 03 21:23:39.258786 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:39.258752 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/0.log" Jun 03 21:23:39.293824 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:39.293790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/1.log" Jun 03 21:23:40.544187 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:40.544138 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795g6s2f_bb122fba-c067-4f0c-bfd1-9357ea01e4ef/istio-proxy/0.log" Jun 03 21:23:40.725514 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:40.725478 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/0.log" Jun 03 21:23:40.757739 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:40.757707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/1.log" Jun 03 21:23:42.767103 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:42.767072 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795g6s2f_bb122fba-c067-4f0c-bfd1-9357ea01e4ef/istio-proxy/0.log" Jun 03 21:23:42.948602 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:42.948570 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/0.log" Jun 03 21:23:42.978932 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:42.978891 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j8x5j_4a88e964-33bd-433d-b151-8e0cd946ff61/istio-proxy/1.log" Jun 03 21:23:43.020598 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.020500 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/kube-multus-additional-cni-plugins/0.log" Jun 03 21:23:43.049550 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.049531 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/egress-router-binary-copy/0.log" Jun 03 21:23:43.078168 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.078145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/cni-plugins/0.log" Jun 03 21:23:43.112153 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.112131 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/bond-cni-plugin/0.log" Jun 03 21:23:43.144232 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.144210 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/routeoverride-cni/0.log" Jun 03 21:23:43.166307 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.166284 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/whereabouts-cni-bincopy/0.log" Jun 03 21:23:43.189602 ip-10-0-128-149 kubenswrapper[2554]: I0603 21:23:43.189582 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt7d7_e915fdfd-d1f6-467b-96ec-411a671ef8de/whereabouts-cni/0.log"