Jun 03 19:30:46.186880 ip-10-0-136-129 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:30:46.625493 ip-10-0-136-129 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:46.626029 ip-10-0-136-129 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:30:46.626029 ip-10-0-136-129 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:46.626029 ip-10-0-136-129 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:30:46.626029 ip-10-0-136-129 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:46.626537 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.626444 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:30:46.632878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632863 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.632878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632876 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632881 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632885 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632888 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632891 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632894 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632903 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632906 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632909 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632911 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632914 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632917 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632919 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632922 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632925 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632929 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632933 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632936 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632939 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.632947 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632942 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632944 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632947 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632950 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632953 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632956 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632958 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632961 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632964 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632967 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632969 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632972 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632974 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632977 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632979 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632982 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632984 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632987 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632995 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.632998 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.633406 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633000 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633003 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633005 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633009 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633011 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633014 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633017 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633020 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633022 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633024 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633027 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633029 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633032 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633034 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633037 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633040 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633043 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633046 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633048 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633051 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.633905 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633053 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633056 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633058 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633061 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633063 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633066 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633069 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633071 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633074 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633079 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633083 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633091 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633094 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633097 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633100 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633103 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633106 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633109 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633112 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.634403 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633114 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633117 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633120 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633122 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633125 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633127 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633130 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633133 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633136 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633139 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633143 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633146 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633148 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633151 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633153 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633156 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633158 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633161 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.633164 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.634878 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634666 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634674 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634677 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634681 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634684 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634686 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634690 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634692 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634695 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634697 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634700 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634703 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634706 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634709 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634711 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634714 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634717 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634720 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634723 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.635347 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634725 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634729 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634731 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634734 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634737 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634739 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634742 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634745 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634747 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634750 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634752 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634755 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634757 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634760 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634762 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634765 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634767 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634770 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634772 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.635881 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634776 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634781 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634784 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634787 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634790 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634793 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634798 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634801 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634804 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634808 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634811 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634814 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634816 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634819 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634822 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634825 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634827 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634830 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634833 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634836 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.636336 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634838 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634841 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634843 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634846 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634849 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634851 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634854 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634856 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634859 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634862 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634864 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634867 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634869 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634872 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634875 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634878 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634880 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634884 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634887 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634889 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.636841 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634892 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634895 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634897 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634900 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634902 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634905 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634908 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634911 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634913 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634916 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634919 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634921 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634924 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634926 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634929 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634933 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634936 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634939 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634942 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.634945 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.637326 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635293 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635298 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635301 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635304 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635306 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635309 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635313 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635316 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635319 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635321 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635324 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635327 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635330 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635332 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635335 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635338 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635341 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635343 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635346 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635349 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.637830 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635352 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635355 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635357 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635361 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635365 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635368 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635371 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635373 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635376 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635378 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635381 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635383 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635386 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635389 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635391 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635394 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635396 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635399 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635401 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.638318 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635404 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635407 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635409 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635412 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635414 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635417 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635420 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635423 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635426 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635428 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635431 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635434 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635436 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635439 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635442 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635446 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635451 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635454 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635457 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635460 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.638794 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635463 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635466 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635468 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635471 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635488 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635490 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635493 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635496 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635499 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635501 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635504 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635510 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635513 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635516 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635518 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635521 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635524 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635527 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635529 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635532 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.639278 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635535 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635537 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635540 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635542 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635545 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635547 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635557 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635560 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635563 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635565 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635568 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635571 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635575 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635578 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635581 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635584 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635586 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635589 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.635592 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635665 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:30:46.639797 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635672 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635678 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635691 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635700 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635704 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635712 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635721 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635727 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635730 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635733 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635736 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635741 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635745 2557 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635748 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635751 2557 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635754 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635757 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635762 2557 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635765 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635768 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635771 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635774 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635778 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:30:46.640297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635781 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635784 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635788 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635791 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635794 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635797 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635800 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635803 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635807 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635810 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635813 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635816 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635821 2557 flags.go:64] FLAG: --enable-server="true" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635824 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635828 2557 flags.go:64] FLAG: --event-burst="100" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635833 2557 flags.go:64] FLAG: --event-qps="50" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635836 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635839 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635842 2557 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635846 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635849 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635851 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635854 2557 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635857 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635860 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:30:46.640901 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635863 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635866 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635869 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635872 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635874 2557 flags.go:64] FLAG: --feature-gates="" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635878 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635881 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635884 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635887 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635890 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635893 2557 flags.go:64] FLAG: --help="false" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635896 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635899 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635902 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635905 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635909 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635912 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635915 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635918 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635922 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635926 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635928 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635936 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635939 2557 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:30:46.641538 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635942 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635946 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635949 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635952 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635954 2557 flags.go:64] FLAG: --lock-file="" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635957 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635960 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635963 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635969 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635971 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635974 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635977 2557 flags.go:64] FLAG: --logging-format="text" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635980 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635983 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635986 2557 flags.go:64] FLAG: --manifest-url="" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635988 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635993 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.635996 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636000 2557 flags.go:64] FLAG: --max-pods="110" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636003 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636006 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636009 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636011 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636014 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636017 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:30:46.642151 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636020 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636027 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636031 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636035 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636038 2557 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636042 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636047 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636050 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636053 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636056 2557 flags.go:64] FLAG: --port="10250" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636059 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636062 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-072b03bc78d66536e" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636065 2557 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636068 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636071 2557 flags.go:64] FLAG: --register-node="true" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636074 2557 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636077 2557 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636080 2557 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636083 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636086 2557 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636089 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636092 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636095 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636098 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636100 2557 flags.go:64] FLAG: --runonce="false" Jun 03 19:30:46.642798 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636103 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636106 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636109 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636112 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636115 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636118 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636121 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636124 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636127 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636129 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636133 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636136 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636141 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636144 2557 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636146 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636152 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636155 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636158 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636162 2557 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636165 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636168 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636170 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636173 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636176 2557 flags.go:64] FLAG: --v="2" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636180 2557 flags.go:64] FLAG: --version="false" Jun 03 19:30:46.643424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636184 2557 flags.go:64] FLAG: --vmodule="" Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636187 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.636190 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636299 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636303 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636306 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636309 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636311 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636314 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636316 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636319 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636321 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636324 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636326 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636329 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636331 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636334 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636339 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636342 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636348 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.644105 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636351 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636354 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636357 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636360 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636364 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636367 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636370 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636372 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636375 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636377 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636380 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636383 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636385 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636388 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636390 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636393 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636396 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636398 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636401 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636403 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.644611 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636406 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636408 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636411 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636414 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636416 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636419 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636421 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636424 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636426 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636430 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636432 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636436 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636439 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636442 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636445 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636447 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636450 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636453 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636456 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636459 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.645099 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636461 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636464 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636466 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636469 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636487 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636491 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636494 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636497 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636500 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636502 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636505 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636508 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636510 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636513 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636516 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636518 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636521 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636523 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636526 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.645682 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636528 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636531 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636534 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636536 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636541 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636545 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636548 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636551 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636554 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636557 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636559 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636562 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636565 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636568 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636570 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636573 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636576 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636578 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636581 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636583 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.646376 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636586 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.636588 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.637877 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.644231 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.644246 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.644263 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.644269 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644332 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644337 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644340 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644343 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644346 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644349 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644351 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644354 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.647075 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644357 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644360 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644363 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644366 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644369 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644371 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644374 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644376 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644379 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644382 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644384 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644387 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644389 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644392 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644394 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644397 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644399 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644402 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644405 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644407 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.647456 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644410 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644414 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644417 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644419 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644422 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644425 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644427 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644430 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644432 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644435 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644438 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644440 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644443 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644445 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644448 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644450 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644453 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644455 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644458 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644461 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.647978 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644463 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644466 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644468 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644471 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644489 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644493 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644495 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644498 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644501 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644504 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644506 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644509 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644514 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644518 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644523 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644526 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644529 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644532 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644535 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.648504 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644537 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644540 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644543 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644545 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644548 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644552 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644556 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644559 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644561 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644564 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644567 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644571 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644574 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644576 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644579 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644582 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644585 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644588 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644590 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.648963 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644593 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644595 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644598 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644600 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644603 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644605 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644608 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644612 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644615 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644618 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644621 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644623 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.644628 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644749 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644754 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:46.649444 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644757 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644760 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644763 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644766 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644769 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644772 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644774 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644777 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644780 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644783 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644786 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644788 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644791 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644794 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644796 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644799 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644802 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644804 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644807 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644810 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:46.649846 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644813 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644815 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644818 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644820 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644823 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644826 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644828 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644831 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644834 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644837 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644839 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644843 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644847 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644850 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644853 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644856 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644859 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644861 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644864 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644867 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:46.650342 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644869 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644872 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644874 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644877 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644880 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644882 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644885 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644888 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644890 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644893 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644896 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644899 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644901 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644904 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644908 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644912 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644914 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644917 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644919 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:46.650839 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644922 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644925 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644927 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644930 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644932 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644935 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644937 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644940 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644942 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644945 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644947 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644950 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644953 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644955 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644958 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644960 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644963 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644966 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644968 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:46.651307 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644971 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644973 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644976 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644979 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644981 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644983 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644986 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644989 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644991 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644995 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.644998 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645000 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645003 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645005 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645008 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645025 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645029 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:46.651797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:46.645032 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.645036 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.645135 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.648337 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.649915 2557 server.go:1019] "Starting client certificate rotation" Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.650014 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:30:46.652214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.650043 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:30:46.652384 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.652369 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:30:46.655688 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.655668 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:30:46.670027 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.670009 2557 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:30:46.672917 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.672900 2557 log.go:25] "Validated CRI v1 image API" Jun 03 19:30:46.673696 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.673671 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:30:46.678465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.678440 2557 fs.go:135] Filesystem UUIDs: map[22e0ecca-1260-4191-ba6e-c7b2fd54e58a:/dev/nvme0n1p4 762fae52-dfcd-47ac-ba7e-41bb9b996f21:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 03 19:30:46.678550 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.678464 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:30:46.681529 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.681509 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:30:46.684553 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.684430 2557 manager.go:216] Machine: {Timestamp:2026-06-03 19:30:46.682996706 +0000 UTC m=+0.368448112 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102652 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27d9e72642a223d0bc427920b4e7a2 SystemUUID:ec27d9e7-2642-a223-d0bc-427920b4e7a2 BootID:feeabfb3-2f7d-45f9-85a5-433c84fdb93d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:f2:e4:b3:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:f2:e4:b3:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:67:ad:a8:50:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:30:46.684553 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.684546 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:30:46.684669 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.684645 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:30:46.687572 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.687536 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:30:46.687744 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.687596 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:30:46.688348 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.688339 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:30:46.688378 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.688351 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:30:46.688378 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.688359 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:30:46.688431 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.688377 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:30:46.689199 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.689190 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:30:46.692530 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692518 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:30:46.692674 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692665 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:30:46.692713 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692705 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:30:46.692745 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692720 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:30:46.692745 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692734 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:30:46.692745 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692742 2557 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:30:46.692852 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.692751 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:30:46.693323 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.693308 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:30:46.693364 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.693334 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:30:46.696371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.696337 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:30:46.697919 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.697902 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:30:46.697995 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.697947 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:30:46.698565 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698554 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:30:46.698601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698571 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:30:46.698601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698578 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:30:46.698601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698583 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:30:46.698601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698592 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:30:46.698601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698598 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:30:46.698768 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698763 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:30:46.698820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698769 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:30:46.698820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698776 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:30:46.698820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698782 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:30:46.698820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698791 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:30:46.698820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.698799 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:30:46.699630 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.699619 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:30:46.699630 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.699630 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:30:46.699780 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.699763 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbrmp" Jun 03 19:30:46.702950 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.702937 2557 server.go:1268] "Started kubelet" Jun 03 19:30:46.703104 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.703055 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:30:46.703891 ip-10-0-136-129 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:30:46.704613 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.704541 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:30:46.704677 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.704646 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:30:46.705698 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.705682 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:30:46.706102 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.706084 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:30:46.707453 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.707431 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbrmp" Jun 03 19:30:46.707789 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.707765 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:30:46.707789 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.707768 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:30:46.707964 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.707918 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:30:46.710503 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.709618 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-129.ec2.internal.18b5a9005bf71922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-129.ec2.internal,UID:ip-10-0-136-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-129.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.702913826 +0000 UTC m=+0.388365233,LastTimestamp:2026-06-03 19:30:46.702913826 +0000 UTC m=+0.388365233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-129.ec2.internal,}" Jun 03 19:30:46.711125 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.711106 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:30:46.712791 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.712777 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:30:46.712870 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.712794 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:30:46.712981 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.712903 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:46.713466 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713448 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:30:46.713554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713448 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:30:46.713554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713498 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:30:46.713663 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713575 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:30:46.713663 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713585 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:30:46.714083 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.713847 2557 factory.go:55] Registering systemd factory Jun 03 19:30:46.714083 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714020 2557 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:30:46.714344 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714234 2557 factory.go:153] Registering CRI-O factory Jun 03 19:30:46.714344 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714254 2557 factory.go:223] Registration of the crio container factory successfully Jun 03 19:30:46.714344 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714331 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:30:46.714529 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714350 2557 factory.go:103] Registering Raw factory Jun 03 19:30:46.714529 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714363 2557 manager.go:1196] Started watching for new ooms in manager Jun 03 19:30:46.714667 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.714643 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:30:46.714888 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.714866 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:30:46.714930 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.714898 2557 manager.go:349] Starting recovery of all containers Jun 03 19:30:46.726684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.726668 2557 manager.go:354] Recovery completed Jun 03 19:30:46.730415 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.730402 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.732235 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732221 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.732303 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732249 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.732303 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732261 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.732761 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732747 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:30:46.732761 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732758 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:30:46.732883 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732762 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.732883 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.732773 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:30:46.733500 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733472 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.733554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733512 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.733554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733527 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.733915 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733904 2557 policy_none.go:49] "None policy: Start" Jun 03 19:30:46.733949 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733921 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:30:46.733949 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.733932 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:30:46.734914 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.734904 2557 policy_none.go:47] "Start" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767207 2557 manager.go:337] "Starting Device Plugin manager" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.767234 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767243 2557 server.go:87] "Starting device plugin registration server" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767471 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767514 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767600 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767678 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.767689 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.768192 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.768267 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.774792 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.775976 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.776017 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.776039 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.776079 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:30:46.781413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.778005 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:46.868542 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.868500 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.869588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.869572 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.869671 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.869601 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.869671 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.869611 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.869671 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.869632 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.875359 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.875342 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.875408 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.875368 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-129.ec2.internal\": node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:46.876555 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.876516 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"] Jun 03 19:30:46.876599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.876571 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.877308 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.877294 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.877371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.877317 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.877371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.877326 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.878676 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.878661 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.878767 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.878760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.878816 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.878784 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.879321 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879305 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.879380 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879334 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.879380 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879343 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.879380 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879314 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.879465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879402 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.879465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.879413 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.880413 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.880396 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.880516 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.880419 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:46.881020 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.881005 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:46.881091 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.881034 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:46.881091 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.881046 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:46.887971 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.887958 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:46.908148 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.908123 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-129.ec2.internal\" not found" node="ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.912611 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.912595 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-129.ec2.internal\" not found" node="ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.914727 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.914712 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2ddd283c46ec457f2982371f0fd3809-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"d2ddd283c46ec457f2982371f0fd3809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.914788 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.914753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.914861 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:46.914782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:46.988531 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:46.988508 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.015734 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.015813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.015813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2ddd283c46ec457f2982371f0fd3809-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"d2ddd283c46ec457f2982371f0fd3809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.015813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015810 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2ddd283c46ec457f2982371f0fd3809-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"d2ddd283c46ec457f2982371f0fd3809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.015936 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015811 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.015936 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.015827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b6094b0d9062c6f6428e8c339125ea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"4b6094b0d9062c6f6428e8c339125ea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.089546 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.089521 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.190166 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.190088 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.211391 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.211369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.216525 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.216509 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:47.290694 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.290670 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.391145 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.391117 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.491652 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.491589 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.592191 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.592165 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.648828 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.648802 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:30:47.649405 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.648926 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:30:47.667427 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:47.667388 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ddd283c46ec457f2982371f0fd3809.slice/crio-0bbd5cd562143fef05e35eb2376fbc6e80f74e819278e60ea61127587e43c1f0 WatchSource:0}: Error finding container 0bbd5cd562143fef05e35eb2376fbc6e80f74e819278e60ea61127587e43c1f0: Status 404 returned error can't find the container with id 0bbd5cd562143fef05e35eb2376fbc6e80f74e819278e60ea61127587e43c1f0 Jun 03 19:30:47.667670 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:47.667657 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6094b0d9062c6f6428e8c339125ea2.slice/crio-254a8b526a79f0285ba6754abdcd772ca90ddc5a548701571e1ccd2166aff23e WatchSource:0}: Error finding container 254a8b526a79f0285ba6754abdcd772ca90ddc5a548701571e1ccd2166aff23e: Status 404 returned error can't find the container with id 254a8b526a79f0285ba6754abdcd772ca90ddc5a548701571e1ccd2166aff23e Jun 03 19:30:47.671489 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.671449 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:30:47.691197 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.691177 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:47.692777 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.692759 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.713823 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.713790 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:25:46 +0000 UTC" deadline="2028-01-06 14:10:47.046814403 +0000 UTC" Jun 03 19:30:47.713883 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.713821 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13962h39m59.33299782s" Jun 03 19:30:47.779778 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.779689 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" event={"ID":"d2ddd283c46ec457f2982371f0fd3809","Type":"ContainerStarted","Data":"0bbd5cd562143fef05e35eb2376fbc6e80f74e819278e60ea61127587e43c1f0"} Jun 03 19:30:47.780752 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:47.780726 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"4b6094b0d9062c6f6428e8c339125ea2","Type":"ContainerStarted","Data":"254a8b526a79f0285ba6754abdcd772ca90ddc5a548701571e1ccd2166aff23e"} Jun 03 19:30:47.793852 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.793830 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.894323 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.894283 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:47.994900 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:47.994854 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:48.095413 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.095336 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:48.196414 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.196370 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:48.296895 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.296858 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found" Jun 03 19:30:48.305565 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.305541 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:48.313214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.313192 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" Jun 03 19:30:48.323339 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.323241 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:30:48.325396 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.325373 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" Jun 03 19:30:48.335930 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.334114 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:30:48.654630 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.654597 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:48.694560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.694530 2557 apiserver.go:52] "Watching apiserver" Jun 03 19:30:48.699679 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.699658 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:30:48.700928 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.700903 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-h75fj","openshift-dns/node-resolver-cnqgg","openshift-image-registry/node-ca-vg85g","openshift-multus/network-metrics-daemon-z5vhs","openshift-network-operator/iptables-alerter-b6pcl","kube-system/global-pull-secret-syncer-74c2p","kube-system/konnectivity-agent-s2ljb","kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal","openshift-multus/multus-additional-cni-plugins-v6wtx","openshift-multus/multus-ghh4s","openshift-network-diagnostics/network-check-target-4xfz2","openshift-ovn-kubernetes/ovnkube-node-f47tl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd"] Jun 03 19:30:48.702565 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.702538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.703854 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.703833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.705011 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.704974 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.705116 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705017 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:30:48.705116 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705048 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.705244 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705231 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8dvl\"" Jun 03 19:30:48.705296 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705280 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.705329 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705235 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:30:48.705698 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.705676 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:30:48.706377 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706354 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.706773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706537 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:30:48.706773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706567 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7tgkh\"" Jun 03 19:30:48.706773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706622 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:30:48.706773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706664 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:30:48.707004 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706878 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.707004 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.706894 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:30:48.707184 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.707165 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.707184 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.707180 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.707332 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.707253 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:48.707729 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.707515 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mwj7b\"" Jun 03 19:30:48.707729 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.707540 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.707729 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.707576 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:30:48.708317 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.708298 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.709666 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.709638 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:48.709752 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.709712 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:48.710244 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.710222 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:30:48.710412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.710396 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.710545 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.710414 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j9qqb\"" Jun 03 19:30:48.710545 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.710521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.711326 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.711073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.713268 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.712366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.713350 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.713333 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lpfkx\"" Jun 03 19:30:48.713432 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.713410 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.714417 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.713591 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.714417 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.713815 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:30:48.714417 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.714298 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.715063 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.714944 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h95s7\"" Jun 03 19:30:48.715182 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.715161 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.716263 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.716012 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.717973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.717954 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:30:48.718125 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.718106 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:30:48.718234 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.718171 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.718296 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.718234 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8tcvl\"" Jun 03 19:30:48.720101 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.720073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.720200 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.720145 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:48.720267 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.720217 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tzxpq\"" Jun 03 19:30:48.720381 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.720353 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:30:48.721492 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.721462 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.723345 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.723318 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.723653 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.723635 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:30:48.723748 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.723691 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.723840 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.723821 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cdlvp\"" Jun 03 19:30:48.724466 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4de66cb-3cc3-4163-9675-d4382fed7fd7-host-slash\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.724599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.724599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.724599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-netns\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-systemd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4de66cb-3cc3-4163-9675-d4382fed7fd7-iptables-alerter-script\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf64506b-7674-44c0-a5e1-2ac34f647f2b-konnectivity-ca\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-slash\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-bin\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-env-overrides\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnwp\" (UniqueName: \"kubernetes.io/projected/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-kube-api-access-jhnwp\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-modprobe-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-sys\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-ovn\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xpf4\" (UniqueName: \"kubernetes.io/projected/a9a78be6-3c36-4274-ba07-08c18b84e659-kube-api-access-8xpf4\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.724875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-host\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6h2p\" (UniqueName: \"kubernetes.io/projected/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-kube-api-access-j6h2p\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.724982 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-kubernetes\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-systemd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-var-lib-kubelet\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725064 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sxtr\" (UniqueName: \"kubernetes.io/projected/2aad1e08-59f9-4f3c-ba3f-406de123624c-kube-api-access-7sxtr\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725111 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-kubelet\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2aad1e08-59f9-4f3c-ba3f-406de123624c-hosts-file\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad1e08-59f9-4f3c-ba3f-406de123624c-tmp-dir\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9z4r\" (UniqueName: \"kubernetes.io/projected/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-kube-api-access-l9z4r\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-netd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2cbr\" (UniqueName: \"kubernetes.io/projected/a4de66cb-3cc3-4163-9675-d4382fed7fd7-kube-api-access-q2cbr\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725315 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-run\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725332 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf64506b-7674-44c0-a5e1-2ac34f647f2b-agent-certs\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-systemd-units\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-log-socket\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysconfig\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-tuned\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-var-lib-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-script-lib\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a78be6-3c36-4274-ba07-08c18b84e659-host\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-conf\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cnibin\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-etc-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-config\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.725927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovn-node-metrics-cert\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725855 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-lib-modules\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-system-cni-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-os-release\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725933 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-tmp\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-node-log\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725975 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbtd\" (UniqueName: \"kubernetes.io/projected/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-kube-api-access-pmbtd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.725999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a78be6-3c36-4274-ba07-08c18b84e659-serviceca\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.726575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.726069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.727892 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.727695 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:30:48.744384 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.744366 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5cbh" Jun 03 19:30:48.752491 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.752461 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5cbh" Jun 03 19:30:48.814294 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.814268 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:30:48.826548 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.826700 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-tuned\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.826700 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-multus\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.826700 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.826700 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826657 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-var-lib-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826700 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-script-lib\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a78be6-3c36-4274-ba07-08c18b84e659-host\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-var-lib-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-conf\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cnibin\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-etc-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826936 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cnibin\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-config\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a78be6-3c36-4274-ba07-08c18b84e659-host\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovn-node-metrics-cert\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.826990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826975 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-etc-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.826939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysctl-conf\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827000 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-lib-modules\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827116 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-socket-dir-parent\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-lib-modules\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-hostroot\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-system-cni-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-os-release\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-tmp\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827276 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-system-cni-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827298 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-os-release\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-multus-certs\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4svg\" (UniqueName: \"kubernetes.io/projected/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-kube-api-access-m4svg\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.827560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-os-release\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-node-log\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827445 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbtd\" (UniqueName: \"kubernetes.io/projected/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-kube-api-access-pmbtd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827506 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-registration-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-script-lib\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827537 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-node-log\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovnkube-config\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-sys-fs\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98lx5\" (UniqueName: \"kubernetes.io/projected/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kube-api-access-98lx5\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a78be6-3c36-4274-ba07-08c18b84e659-serviceca\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.827748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-device-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-etc-selinux\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828302 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4de66cb-3cc3-4163-9675-d4382fed7fd7-host-slash\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.828343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-netns\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-netns\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-kubelet\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828563 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-systemd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828703 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.829071 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829001 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a78be6-3c36-4274-ba07-08c18b84e659-serviceca\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.829390 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.829112 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:48.829390 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.829199 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.329177968 +0000 UTC m=+3.014629382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:48.829390 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.829390 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829327 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4de66cb-3cc3-4163-9675-d4382fed7fd7-host-slash\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.829622 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-netns\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829622 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.828517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-systemd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829721 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4de66cb-3cc3-4163-9675-d4382fed7fd7-iptables-alerter-script\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.829721 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829661 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-etc-kubernetes\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.829813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf64506b-7674-44c0-a5e1-2ac34f647f2b-konnectivity-ca\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.829813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-slash\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-bin\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-env-overrides\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.829927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.829927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.829859 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnwp\" (UniqueName: \"kubernetes.io/projected/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-kube-api-access-jhnwp\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.830348 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830140 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-slash\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.830348 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830212 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-bin\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.830547 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830526 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-tmp\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830657 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-tuned\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830714 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-modprobe-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830714 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-env-overrides\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.830813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-sys\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-modprobe-d\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cni-binary-copy\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.830973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830828 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-sys\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.830973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-ovn\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.830973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830855 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-ovn-node-metrics-cert\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.830973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830904 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xpf4\" (UniqueName: \"kubernetes.io/projected/a9a78be6-3c36-4274-ba07-08c18b84e659-kube-api-access-8xpf4\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.830973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cnibin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830978 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-ovn\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.830996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-k8s-cni-cncf-io\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831040 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf64506b-7674-44c0-a5e1-2ac34f647f2b-konnectivity-ca\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-conf-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-dbus\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.831220 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-host\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6h2p\" (UniqueName: \"kubernetes.io/projected/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-kube-api-access-j6h2p\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4de66cb-3cc3-4163-9675-d4382fed7fd7-iptables-alerter-script\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831255 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-kubernetes\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-host\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-systemd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-var-lib-kubelet\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-daemon-config\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.831549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxtr\" (UniqueName: \"kubernetes.io/projected/2aad1e08-59f9-4f3c-ba3f-406de123624c-kube-api-access-7sxtr\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831626 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-var-lib-kubelet\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-kubelet\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-kubelet\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831678 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-system-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831787 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2aad1e08-59f9-4f3c-ba3f-406de123624c-hosts-file\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831808 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-systemd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831820 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad1e08-59f9-4f3c-ba3f-406de123624c-tmp-dir\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9z4r\" (UniqueName: \"kubernetes.io/projected/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-kube-api-access-l9z4r\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-netd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.831984 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-bin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.831999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-socket-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2cbr\" (UniqueName: \"kubernetes.io/projected/a4de66cb-3cc3-4163-9675-d4382fed7fd7-kube-api-access-q2cbr\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832055 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-kubernetes\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832162 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-run-openvswitch\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2aad1e08-59f9-4f3c-ba3f-406de123624c-hosts-file\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-run\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832312 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf64506b-7674-44c0-a5e1-2ac34f647f2b-agent-certs\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-systemd-units\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-log-socket\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-kubelet-config\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.832588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832569 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad1e08-59f9-4f3c-ba3f-406de123624c-tmp-dir\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832593 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-systemd-units\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-run\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832690 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysconfig\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832789 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-etc-sysconfig\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.833149 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.832833 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-host-cni-netd\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.833430 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.833219 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-log-socket\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.833430 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.833313 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.835386 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.835347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf64506b-7674-44c0-a5e1-2ac34f647f2b-agent-certs\") pod \"konnectivity-agent-s2ljb\" (UID: \"cf64506b-7674-44c0-a5e1-2ac34f647f2b\") " pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:48.838574 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.838546 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:48.838766 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.838752 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:48.838866 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.838856 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:48.839762 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.839736 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbtd\" (UniqueName: \"kubernetes.io/projected/10b3d2c8-6fa3-4125-bd99-5562d98b64ed-kube-api-access-pmbtd\") pod \"tuned-h75fj\" (UID: \"10b3d2c8-6fa3-4125-bd99-5562d98b64ed\") " pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:48.839894 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.839876 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.33985576 +0000 UTC m=+3.025307167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:48.840356 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.840330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnwp\" (UniqueName: \"kubernetes.io/projected/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-kube-api-access-jhnwp\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:48.840660 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.840640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sxtr\" (UniqueName: \"kubernetes.io/projected/2aad1e08-59f9-4f3c-ba3f-406de123624c-kube-api-access-7sxtr\") pod \"node-resolver-cnqgg\" (UID: \"2aad1e08-59f9-4f3c-ba3f-406de123624c\") " pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:48.840772 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.840733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xpf4\" (UniqueName: \"kubernetes.io/projected/a9a78be6-3c36-4274-ba07-08c18b84e659-kube-api-access-8xpf4\") pod \"node-ca-vg85g\" (UID: \"a9a78be6-3c36-4274-ba07-08c18b84e659\") " pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:48.841531 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.841509 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6h2p\" (UniqueName: \"kubernetes.io/projected/a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11-kube-api-access-j6h2p\") pod \"ovnkube-node-f47tl\" (UID: \"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:48.841746 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.841719 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2cbr\" (UniqueName: \"kubernetes.io/projected/a4de66cb-3cc3-4163-9675-d4382fed7fd7-kube-api-access-q2cbr\") pod \"iptables-alerter-b6pcl\" (UID: \"a4de66cb-3cc3-4163-9675-d4382fed7fd7\") " pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:48.842257 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.842234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9z4r\" (UniqueName: \"kubernetes.io/projected/4e2e1f10-313e-4772-9fda-51e7ab47e1ba-kube-api-access-l9z4r\") pod \"multus-additional-cni-plugins-v6wtx\" (UID: \"4e2e1f10-313e-4772-9fda-51e7ab47e1ba\") " pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:48.867998 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.867977 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:48.933938 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.933858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-kubelet-config\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.933938 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.933896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-multus\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.933938 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.933917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.933979 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-kubelet-config\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.933993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-multus\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.934017 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-socket-dir-parent\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:48.934065 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.434050305 +0000 UTC m=+3.119501715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-hostroot\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934103 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-socket-dir-parent\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934120 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-os-release\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-multus-certs\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-hostroot\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934187 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4svg\" (UniqueName: \"kubernetes.io/projected/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-kube-api-access-m4svg\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-multus-certs\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-os-release\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-registration-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-sys-fs\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98lx5\" (UniqueName: \"kubernetes.io/projected/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kube-api-access-98lx5\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934319 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-registration-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-device-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934358 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-etc-selinux\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-sys-fs\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934387 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-netns\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934419 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-netns\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-device-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.934747 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934510 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-kubelet\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934538 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-etc-selinux\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-etc-kubernetes\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934600 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-kubelet\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-etc-kubernetes\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934651 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cni-binary-copy\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cnibin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-k8s-cni-cncf-io\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934751 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-run-k8s-cni-cncf-io\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cnibin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-conf-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934837 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-dbus\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-daemon-config\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-system-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-bin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.934943 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-socket-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935005 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/867b41e5-9cad-41fb-825c-c25cba40d388-dbus\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-conf-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.935543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935089 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e1f0035-b432-46b8-89fa-a4dd282a5f57-socket-dir\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.936371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935094 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-system-cni-dir\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.936371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-host-var-lib-cni-bin\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.936371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935192 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-cni-binary-copy\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.936371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.935491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-multus-daemon-config\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:48.944099 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.944076 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98lx5\" (UniqueName: \"kubernetes.io/projected/8e1f0035-b432-46b8-89fa-a4dd282a5f57-kube-api-access-98lx5\") pod \"aws-ebs-csi-driver-node-mcvkd\" (UID: \"8e1f0035-b432-46b8-89fa-a4dd282a5f57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:48.944224 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:48.944104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4svg\" (UniqueName: \"kubernetes.io/projected/c08f4a7c-1e55-4b76-bd80-ec3f1179b204-kube-api-access-m4svg\") pod \"multus-ghh4s\" (UID: \"c08f4a7c-1e55-4b76-bd80-ec3f1179b204\") " pod="openshift-multus/multus-ghh4s" Jun 03 19:30:49.017265 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.017234 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" Jun 03 19:30:49.022532 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.022507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:30:49.032108 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.032088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:30:49.038825 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.038806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vg85g" Jun 03 19:30:49.047208 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.047187 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6pcl" Jun 03 19:30:49.054008 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.053984 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h75fj" Jun 03 19:30:49.061733 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.061715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cnqgg" Jun 03 19:30:49.067192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.067174 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghh4s" Jun 03 19:30:49.070805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.070790 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" Jun 03 19:30:49.337495 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.337413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:49.337653 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.337525 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:49.337653 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.337582 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:30:50.337564016 +0000 UTC m=+4.023015425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:49.438372 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.438339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:49.438555 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.438428 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:49.438555 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438505 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:49.438555 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438548 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:49.438705 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438563 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:49.438705 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438571 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:50.438551992 +0000 UTC m=+4.124003388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:49.438705 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438575 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:49.438705 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.438610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:30:50.438599035 +0000 UTC m=+4.124050431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:49.523358 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.523329 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bb0f0e_7c9b_4736_a956_cbcbfeae4d11.slice/crio-ad09a8ef44fc5a19d9fc44063455591b5a2a6b81018d17b3656db8f008fcadcf WatchSource:0}: Error finding container ad09a8ef44fc5a19d9fc44063455591b5a2a6b81018d17b3656db8f008fcadcf: Status 404 returned error can't find the container with id ad09a8ef44fc5a19d9fc44063455591b5a2a6b81018d17b3656db8f008fcadcf Jun 03 19:30:49.525254 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.525052 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08f4a7c_1e55_4b76_bd80_ec3f1179b204.slice/crio-62498b9cc293d94ac69eeba50cd6afe60d863daf5dbb6586d55907e4f8f1cb80 WatchSource:0}: Error finding container 62498b9cc293d94ac69eeba50cd6afe60d863daf5dbb6586d55907e4f8f1cb80: Status 404 returned error can't find the container with id 62498b9cc293d94ac69eeba50cd6afe60d863daf5dbb6586d55907e4f8f1cb80 Jun 03 19:30:49.528327 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.528299 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1f0035_b432_46b8_89fa_a4dd282a5f57.slice/crio-66a96fd8d97a6ad31352ef041a2e30a2b80a6b8e867e0f9bf3017cbc5df9e43e WatchSource:0}: Error finding container 66a96fd8d97a6ad31352ef041a2e30a2b80a6b8e867e0f9bf3017cbc5df9e43e: Status 404 returned error can't find the container with id 66a96fd8d97a6ad31352ef041a2e30a2b80a6b8e867e0f9bf3017cbc5df9e43e Jun 03 19:30:49.530911 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.530886 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2e1f10_313e_4772_9fda_51e7ab47e1ba.slice/crio-4a7a5b6e192b932109cd1d960bb72d35e6bc760b7e73c4b891f88a870f29b617 WatchSource:0}: Error finding container 4a7a5b6e192b932109cd1d960bb72d35e6bc760b7e73c4b891f88a870f29b617: Status 404 returned error can't find the container with id 4a7a5b6e192b932109cd1d960bb72d35e6bc760b7e73c4b891f88a870f29b617 Jun 03 19:30:49.531695 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.531675 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a78be6_3c36_4274_ba07_08c18b84e659.slice/crio-563b0e67ecaec0224cb540886edfafc3d3024add5f1786225cc799f1d9f1a408 WatchSource:0}: Error finding container 563b0e67ecaec0224cb540886edfafc3d3024add5f1786225cc799f1d9f1a408: Status 404 returned error can't find the container with id 563b0e67ecaec0224cb540886edfafc3d3024add5f1786225cc799f1d9f1a408 Jun 03 19:30:49.533379 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.533346 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4de66cb_3cc3_4163_9675_d4382fed7fd7.slice/crio-12eb44ae5a6f7e60d2d749ac56f39aba10af5c222ff9f962915b9dd0462ca980 WatchSource:0}: Error finding container 12eb44ae5a6f7e60d2d749ac56f39aba10af5c222ff9f962915b9dd0462ca980: Status 404 returned error can't find the container with id 12eb44ae5a6f7e60d2d749ac56f39aba10af5c222ff9f962915b9dd0462ca980 Jun 03 19:30:49.534253 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.534230 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf64506b_7674_44c0_a5e1_2ac34f647f2b.slice/crio-8cfffc3009fc8447a945d5163af620c16c9b6b1a51a26611ad944b5d36e3854c WatchSource:0}: Error finding container 8cfffc3009fc8447a945d5163af620c16c9b6b1a51a26611ad944b5d36e3854c: Status 404 returned error can't find the container with id 8cfffc3009fc8447a945d5163af620c16c9b6b1a51a26611ad944b5d36e3854c Jun 03 19:30:49.535101 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.535074 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b3d2c8_6fa3_4125_bd99_5562d98b64ed.slice/crio-048a286696981e09fdbff681bf084c0a71a0f24d4d9c5def49a1facddc056ca3 WatchSource:0}: Error finding container 048a286696981e09fdbff681bf084c0a71a0f24d4d9c5def49a1facddc056ca3: Status 404 returned error can't find the container with id 048a286696981e09fdbff681bf084c0a71a0f24d4d9c5def49a1facddc056ca3 Jun 03 19:30:49.536785 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:30:49.536744 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aad1e08_59f9_4f3c_ba3f_406de123624c.slice/crio-2f1109304e3d8c10d339d0f7d1e2486a48789385ac57fff71a2113b1efb5ac16 WatchSource:0}: Error finding container 2f1109304e3d8c10d339d0f7d1e2486a48789385ac57fff71a2113b1efb5ac16: Status 404 returned error can't find the container with id 2f1109304e3d8c10d339d0f7d1e2486a48789385ac57fff71a2113b1efb5ac16 Jun 03 19:30:49.754911 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.754877 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:48 +0000 UTC" deadline="2028-02-23 21:23:13.625002648 +0000 UTC" Jun 03 19:30:49.754911 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.754911 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15121h52m23.87009601s" Jun 03 19:30:49.776321 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.776300 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:49.776452 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:49.776434 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:49.784857 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.784831 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerStarted","Data":"4a7a5b6e192b932109cd1d960bb72d35e6bc760b7e73c4b891f88a870f29b617"} Jun 03 19:30:49.789376 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.789352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" event={"ID":"d2ddd283c46ec457f2982371f0fd3809","Type":"ContainerStarted","Data":"a76e2178f4304e65230471dcf955ec2acb07c75c2267f21fa2df9aecb4cba37b"} Jun 03 19:30:49.790755 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.790734 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"4b6094b0d9062c6f6428e8c339125ea2","Type":"ContainerStarted","Data":"513dabd7f66f83bd121e4dc122f3b19bdd905c2c0494e502705a78fc33d34993"} Jun 03 19:30:49.794407 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.794383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2ljb" event={"ID":"cf64506b-7674-44c0-a5e1-2ac34f647f2b","Type":"ContainerStarted","Data":"8cfffc3009fc8447a945d5163af620c16c9b6b1a51a26611ad944b5d36e3854c"} Jun 03 19:30:49.795581 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.795556 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6pcl" event={"ID":"a4de66cb-3cc3-4163-9675-d4382fed7fd7","Type":"ContainerStarted","Data":"12eb44ae5a6f7e60d2d749ac56f39aba10af5c222ff9f962915b9dd0462ca980"} Jun 03 19:30:49.796551 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.796533 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" event={"ID":"8e1f0035-b432-46b8-89fa-a4dd282a5f57","Type":"ContainerStarted","Data":"66a96fd8d97a6ad31352ef041a2e30a2b80a6b8e867e0f9bf3017cbc5df9e43e"} Jun 03 19:30:49.797592 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.797573 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghh4s" event={"ID":"c08f4a7c-1e55-4b76-bd80-ec3f1179b204","Type":"ContainerStarted","Data":"62498b9cc293d94ac69eeba50cd6afe60d863daf5dbb6586d55907e4f8f1cb80"} Jun 03 19:30:49.799181 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.799163 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"ad09a8ef44fc5a19d9fc44063455591b5a2a6b81018d17b3656db8f008fcadcf"} Jun 03 19:30:49.800176 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.800158 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cnqgg" event={"ID":"2aad1e08-59f9-4f3c-ba3f-406de123624c","Type":"ContainerStarted","Data":"2f1109304e3d8c10d339d0f7d1e2486a48789385ac57fff71a2113b1efb5ac16"} Jun 03 19:30:49.801229 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.801205 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h75fj" event={"ID":"10b3d2c8-6fa3-4125-bd99-5562d98b64ed","Type":"ContainerStarted","Data":"048a286696981e09fdbff681bf084c0a71a0f24d4d9c5def49a1facddc056ca3"} Jun 03 19:30:49.801771 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.801726 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" podStartSLOduration=1.801712268 podStartE2EDuration="1.801712268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:49.801315403 +0000 UTC m=+3.486766832" watchObservedRunningTime="2026-06-03 19:30:49.801712268 +0000 UTC m=+3.487163686" Jun 03 19:30:49.802139 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:49.802122 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vg85g" event={"ID":"a9a78be6-3c36-4274-ba07-08c18b84e659","Type":"ContainerStarted","Data":"563b0e67ecaec0224cb540886edfafc3d3024add5f1786225cc799f1d9f1a408"} Jun 03 19:30:50.345765 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.345728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:50.345968 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.345948 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:50.346040 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.346007 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.345988811 +0000 UTC m=+6.031440207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.447038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.447094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447231 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447291 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.447273394 +0000 UTC m=+6.132724790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447715 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447733 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447746 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:50.447826 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.447791 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.447776518 +0000 UTC m=+6.133227915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:50.755216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.755080 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:48 +0000 UTC" deadline="2028-01-02 12:06:04.80519101 +0000 UTC" Jun 03 19:30:50.755216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.755134 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13864h35m14.050060618s" Jun 03 19:30:50.777630 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.777599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:50.777848 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.777740 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:50.778343 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.778064 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:50.778343 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:50.778157 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:50.818017 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.817977 2557 generic.go:356] "Generic (PLEG): container finished" podID="4b6094b0d9062c6f6428e8c339125ea2" containerID="513dabd7f66f83bd121e4dc122f3b19bdd905c2c0494e502705a78fc33d34993" exitCode=0 Jun 03 19:30:50.819042 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:50.819016 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"4b6094b0d9062c6f6428e8c339125ea2","Type":"ContainerDied","Data":"513dabd7f66f83bd121e4dc122f3b19bdd905c2c0494e502705a78fc33d34993"} Jun 03 19:30:51.777044 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:51.776575 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:51.777044 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:51.776705 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:51.838899 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:51.838862 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"4b6094b0d9062c6f6428e8c339125ea2","Type":"ContainerStarted","Data":"3abc2bc63a1db6c4db88eedd0b19632e2395dd50335d3b5e96e9f21f05b0a072"} Jun 03 19:30:52.364940 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:52.364900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:52.365123 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.365079 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:52.365188 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.365163 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:30:56.365141288 +0000 UTC m=+10.050592699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:52.465591 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:52.465554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:52.465761 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:52.465616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:52.465848 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.465769 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:52.465906 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.465870 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:56.465850292 +0000 UTC m=+10.151301704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:52.466352 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.466330 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:52.466450 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.466356 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:52.466450 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.466372 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:52.466450 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.466418 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:30:56.466401111 +0000 UTC m=+10.151852518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:52.778647 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:52.777046 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:52.778647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.777198 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:52.778647 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:52.777046 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:52.778647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:52.777651 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:53.776769 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:53.776730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:53.776950 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:53.776868 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:54.777311 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:54.777208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:54.777846 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:54.777345 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:54.777846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:54.777488 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:54.777846 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:54.777661 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:55.776470 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:55.776433 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:55.776758 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:55.776595 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:56.399652 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:56.399575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:56.400074 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.399716 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:56.400074 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.399790 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:31:04.399769761 +0000 UTC m=+18.085221158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:56.500762 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:56.500724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:56.500937 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:56.500784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:56.500937 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500891 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:56.500937 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500896 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:56.500937 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500916 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:56.500937 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500926 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:56.501179 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500955 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:04.500934196 +0000 UTC m=+18.186385595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:56.501179 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.500974 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:31:04.500964259 +0000 UTC m=+18.186415658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:56.778184 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:56.777468 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:56.778184 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.777600 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:56.778184 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:56.777988 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:56.778184 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:56.778100 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:57.776461 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:57.776394 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:57.776951 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:57.776544 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:30:58.777824 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:58.777280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:30:58.777824 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:58.777455 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:30:58.777824 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:58.777513 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:30:58.777824 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:58.777620 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:30:59.777089 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:30:59.777051 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:30:59.777260 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:30:59.777169 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:00.776822 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:00.776789 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:00.777280 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:00.776794 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:00.777280 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:00.776933 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:00.777280 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:00.777002 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:01.776264 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:01.776230 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:01.776411 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:01.776370 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:02.777024 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:02.776986 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:02.777431 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:02.777116 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:02.777431 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:02.777128 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:02.777431 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:02.777241 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:03.776320 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:03.776279 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:03.776536 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:03.776399 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:04.457214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:04.457171 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:04.457691 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.457347 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:04.457691 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.457422 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:31:20.457403428 +0000 UTC m=+34.142854829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:04.558072 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:04.558028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:04.558072 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:04.558081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:04.558288 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558200 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:04.558288 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558222 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:31:04.558288 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558248 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:31:04.558288 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558262 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:04.558428 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558262 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:20.558242684 +0000 UTC m=+34.243694092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:04.558428 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.558327 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:31:20.558310026 +0000 UTC m=+34.243761423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:04.777416 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:04.777341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:04.777587 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.777464 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:04.777587 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:04.777508 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:04.777673 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:04.777586 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:05.776323 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:05.776289 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:05.776738 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:05.776424 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:06.777143 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:06.777115 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:06.777726 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:06.777179 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:06.777726 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:06.777248 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:06.777726 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:06.777348 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:07.776803 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.776654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:07.776924 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:07.776888 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:07.871006 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.870960 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"14f99f77508d1c046a7d4bd4bea3733c812d23049176cb499980d70c66112b33"} Jun 03 19:31:07.871959 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.871073 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"671ca2e344f4f96955ad5724d159de618583953849361cee493fa5c5cd4ca272"} Jun 03 19:31:07.872647 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.872614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cnqgg" event={"ID":"2aad1e08-59f9-4f3c-ba3f-406de123624c","Type":"ContainerStarted","Data":"e64b7c6ebab3915516994f440b8267c6158fd0787a2b36b334181663e930ead9"} Jun 03 19:31:07.874199 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.874177 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h75fj" event={"ID":"10b3d2c8-6fa3-4125-bd99-5562d98b64ed","Type":"ContainerStarted","Data":"a190e01975e4ed6e55408bd0c0797649e2b430b9c9d55ff8b8a5361398a03d58"} Jun 03 19:31:07.875990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.875962 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vg85g" event={"ID":"a9a78be6-3c36-4274-ba07-08c18b84e659","Type":"ContainerStarted","Data":"df45a1bda0a1c2b9a303ac16cb8b3d354439bfad46cbea226a3ca83d1d472253"} Jun 03 19:31:07.877537 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.877515 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerStarted","Data":"0bda2f927d9b4d2b6707f958fc2dad606fbc686fcbf0d79ba260c9c91a68bd9e"} Jun 03 19:31:07.878903 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.878836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2ljb" event={"ID":"cf64506b-7674-44c0-a5e1-2ac34f647f2b","Type":"ContainerStarted","Data":"a7f9c7047b01301f38632a83fd1933e4ad2fd28753201ffeed52753d1c466900"} Jun 03 19:31:07.880503 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.880457 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" event={"ID":"8e1f0035-b432-46b8-89fa-a4dd282a5f57","Type":"ContainerStarted","Data":"0b5470e79b36bd71b1e428153d4293105b6a970a637d3f3129195069c5998adc"} Jun 03 19:31:07.881863 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.881844 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghh4s" event={"ID":"c08f4a7c-1e55-4b76-bd80-ec3f1179b204","Type":"ContainerStarted","Data":"e86da0c2e905a029c5fbfa018de7fec048e43fa06d9d54b77afccd7e6de52c67"} Jun 03 19:31:07.885983 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.885946 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" podStartSLOduration=19.885935324 podStartE2EDuration="19.885935324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:51.857238082 +0000 UTC m=+5.542689499" watchObservedRunningTime="2026-06-03 19:31:07.885935324 +0000 UTC m=+21.571386739" Jun 03 19:31:07.886468 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.886434 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cnqgg" podStartSLOduration=4.149525883 podStartE2EDuration="21.886419652s" totalImagesPullingTime="17.736893769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:07.885743532 +0000 UTC m=+21.571194949" watchObservedRunningTime="2026-06-03 19:31:07.886419652 +0000 UTC m=+21.571871068" Jun 03 19:31:07.918920 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.918866 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vg85g" podStartSLOduration=4.176492706 podStartE2EDuration="21.918823827s" totalImagesPullingTime="17.742331121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:07.918099508 +0000 UTC m=+21.603550925" watchObservedRunningTime="2026-06-03 19:31:07.918823827 +0000 UTC m=+21.604275245" Jun 03 19:31:07.934135 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.934083 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h75fj" podStartSLOduration=3.99708247 podStartE2EDuration="21.934065771s" totalImagesPullingTime="17.936983301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:07.933676823 +0000 UTC m=+21.619128239" watchObservedRunningTime="2026-06-03 19:31:07.934065771 +0000 UTC m=+21.619517187" Jun 03 19:31:07.964038 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:07.963646 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s2ljb" podStartSLOduration=3.224754091 podStartE2EDuration="20.96362748s" totalImagesPullingTime="17.738873389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:07.963467628 +0000 UTC m=+21.648919044" watchObservedRunningTime="2026-06-03 19:31:07.96362748 +0000 UTC m=+21.649078893" Jun 03 19:31:08.000439 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.000346 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ghh4s" podStartSLOduration=3.0536987780000002 podStartE2EDuration="21.000329628s" totalImagesPullingTime="17.94663085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.000228904 +0000 UTC m=+21.685680341" watchObservedRunningTime="2026-06-03 19:31:08.000329628 +0000 UTC m=+21.685781044" Jun 03 19:31:08.776957 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.776922 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:08.777179 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.776968 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:08.777179 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:08.777061 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:08.777284 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:08.777190 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:08.885031 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.884992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6pcl" event={"ID":"a4de66cb-3cc3-4163-9675-d4382fed7fd7","Type":"ContainerStarted","Data":"8f95eda0f00c57017c299a93308b2d28146aac2195fa8165f3aa63c91acfde1a"} Jun 03 19:31:08.887630 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.887613 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:31:08.888025 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888008 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11" containerID="14f99f77508d1c046a7d4bd4bea3733c812d23049176cb499980d70c66112b33" exitCode=1 Jun 03 19:31:08.888083 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888067 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerDied","Data":"14f99f77508d1c046a7d4bd4bea3733c812d23049176cb499980d70c66112b33"} Jun 03 19:31:08.888142 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888127 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"b8b11a7fae8249be4716f807d21a36774b158f3e779902497dcb1e68975800a5"} Jun 03 19:31:08.888188 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"4b892675651618e84517df7f9e643711f14ec6d777c2b062236bd2bab1bbbe5e"} Jun 03 19:31:08.888231 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888210 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"f7c7f55cf109af5e976f90941925629e024f027a556919c0d3a84c89961ddb68"} Jun 03 19:31:08.888266 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.888253 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"1f6edc0d5a02f613bcdfc37ddb7eef7f903729f3cd468398b17e04abe046a4ff"} Jun 03 19:31:08.889335 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.889312 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="0bda2f927d9b4d2b6707f958fc2dad606fbc686fcbf0d79ba260c9c91a68bd9e" exitCode=0 Jun 03 19:31:08.889425 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.889397 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"0bda2f927d9b4d2b6707f958fc2dad606fbc686fcbf0d79ba260c9c91a68bd9e"} Jun 03 19:31:08.898512 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:08.898454 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b6pcl" podStartSLOduration=5.157757672 podStartE2EDuration="22.89844319s" totalImagesPullingTime="17.740685518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.898216739 +0000 UTC m=+22.583668154" watchObservedRunningTime="2026-06-03 19:31:08.89844319 +0000 UTC m=+22.583894606" Jun 03 19:31:09.097087 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.096957 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:31:09.776949 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.776915 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:09.777160 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:09.777045 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:09.779257 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.779130 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:31:09.097080002Z","UUID":"3d088002-ca85-4e82-a97c-4c4d3f04f5a8","Handler":null,"Name":"","Endpoint":""} Jun 03 19:31:09.781044 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.781023 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:31:09.781190 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.781069 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:31:09.894068 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:09.893980 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" event={"ID":"8e1f0035-b432-46b8-89fa-a4dd282a5f57","Type":"ContainerStarted","Data":"543dca209ad70657685318bfbd9c6451c72e7337471c152baa340f4c782e948a"} Jun 03 19:31:10.780465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.780386 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:10.780465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.780403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:10.780708 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:10.780553 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:10.780708 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:10.780636 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:10.898960 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.898926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" event={"ID":"8e1f0035-b432-46b8-89fa-a4dd282a5f57","Type":"ContainerStarted","Data":"86e75c541e7706384845f1141186265ed383441885a76bffacfaa8b319cee76d"} Jun 03 19:31:10.902604 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.902580 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:31:10.903046 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.903012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"e770b28480230400823b9a05208d6d4d2b686b4309aaf3b9815eba91115b2565"} Jun 03 19:31:10.917643 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:10.917605 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mcvkd" podStartSLOduration=3.761534729 podStartE2EDuration="23.917592493s" totalImagesPullingTime="20.156057764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:10.917137147 +0000 UTC m=+24.602588567" watchObservedRunningTime="2026-06-03 19:31:10.917592493 +0000 UTC m=+24.603043909" Jun 03 19:31:11.776440 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:11.776409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:11.776615 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:11.776529 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:12.076823 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:12.076746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:31:12.077447 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:12.077328 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:31:12.780363 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:12.780295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:12.780531 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:12.780410 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:12.780531 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:12.780455 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:12.780635 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:12.780555 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:13.777221 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.777053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:13.777715 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:13.777294 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:13.914986 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.914952 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="9c5b0014f381b8ff70bca1369e066620a40c13183608558e9c4e9e5560f91aa1" exitCode=0 Jun 03 19:31:13.915133 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.915036 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"9c5b0014f381b8ff70bca1369e066620a40c13183608558e9c4e9e5560f91aa1"} Jun 03 19:31:13.918641 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.918623 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:31:13.918974 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.918953 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"b421fe9df3b0b1d977635c7c2501dee1d1200aeea9598d9329c5cc260a7c0ac5"} Jun 03 19:31:13.919216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.919201 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:13.919305 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.919265 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:13.919363 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.919338 2557 scope.go:117] "RemoveContainer" containerID="14f99f77508d1c046a7d4bd4bea3733c812d23049176cb499980d70c66112b33" Jun 03 19:31:13.935771 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:13.935753 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:14.777093 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.776892 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:14.777239 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.776929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:14.777239 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:14.777144 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:14.777239 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:14.777205 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:14.862429 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.862391 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-74c2p"] Jun 03 19:31:14.862585 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.862516 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:14.862628 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:14.862599 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:14.865722 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.865695 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5vhs"] Jun 03 19:31:14.866224 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.866206 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xfz2"] Jun 03 19:31:14.923447 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.923407 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="cf378cbe0c8f6a5d980a5d7f4635aa652dbe169bb2ba9da1ee642e8d0b095b63" exitCode=0 Jun 03 19:31:14.923616 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.923514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"cf378cbe0c8f6a5d980a5d7f4635aa652dbe169bb2ba9da1ee642e8d0b095b63"} Jun 03 19:31:14.927233 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.927217 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:31:14.927586 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.927572 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:14.927659 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.927598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" event={"ID":"a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11","Type":"ContainerStarted","Data":"19b2d73be7f905fa11451be3f8f89cc20b3515e76e0dd241fe7eaecdf70f3cea"} Jun 03 19:31:14.927700 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:14.927666 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:14.927780 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.927763 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:14.927822 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.927807 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:14.927923 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:14.927905 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:14.944046 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.944022 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:14.969410 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:14.969373 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" podStartSLOduration=10.969939779 podStartE2EDuration="28.969360025s" totalImagesPullingTime="17.999420246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:14.969169611 +0000 UTC m=+28.654621026" watchObservedRunningTime="2026-06-03 19:31:14.969360025 +0000 UTC m=+28.654811424" Jun 03 19:31:15.932041 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:15.932009 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="a45dfe15a3ffef1da92283d3fd8aa290958d5106624dea27481ced5d6222c033" exitCode=0 Jun 03 19:31:15.932720 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:15.932102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"a45dfe15a3ffef1da92283d3fd8aa290958d5106624dea27481ced5d6222c033"} Jun 03 19:31:16.777570 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:16.777501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:16.777570 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:16.777543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:16.777780 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:16.777617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:16.777780 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:16.777709 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:16.777780 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:16.777728 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:16.777947 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:16.777821 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:17.864228 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:17.864193 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:31:17.864909 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:17.864335 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 19:31:17.864909 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:17.864791 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s2ljb" Jun 03 19:31:18.776432 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:18.776403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:18.776621 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:18.776403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:18.776621 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:18.776533 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xfz2" podUID="c0be0683-37f7-48c3-948a-43a083f1cf1e" Jun 03 19:31:18.776621 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:18.776413 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:18.776621 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:18.776582 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:31:18.776817 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:18.776668 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-74c2p" podUID="867b41e5-9cad-41fb-825c-c25cba40d388" Jun 03 19:31:20.482604 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.482516 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:20.483048 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.482689 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:20.483048 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.482767 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:31:52.482749416 +0000 UTC m=+66.168200814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:20.583430 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.583386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.583471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583568 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583609 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583623 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583633 2557 projected.go:196] Error preparing data for projected volume kube-api-access-n9fzh for pod openshift-network-diagnostics/network-check-target-4xfz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:20.583647 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583628 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret podName:867b41e5-9cad-41fb-825c-c25cba40d388 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:52.583614617 +0000 UTC m=+66.269066011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret") pod "global-pull-secret-syncer-74c2p" (UID: "867b41e5-9cad-41fb-825c-c25cba40d388") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:20.583963 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.583676 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh podName:c0be0683-37f7-48c3-948a-43a083f1cf1e nodeName:}" failed. No retries permitted until 2026-06-03 19:31:52.583660286 +0000 UTC m=+66.269111680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9fzh" (UniqueName: "kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh") pod "network-check-target-4xfz2" (UID: "c0be0683-37f7-48c3-948a-43a083f1cf1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:20.631707 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.631676 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeReady" Jun 03 19:31:20.631881 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.631825 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:31:20.675591 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.675554 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6bj5l"] Jun 03 19:31:20.699185 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.699153 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jrv6f"] Jun 03 19:31:20.699344 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.699318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.701766 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.701727 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:31:20.701907 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.701727 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:31:20.701907 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.701734 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\"" Jun 03 19:31:20.712580 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.712415 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6bj5l"] Jun 03 19:31:20.712694 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.712605 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrv6f"] Jun 03 19:31:20.712694 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.712543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.714971 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.714949 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:31:20.715104 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.715078 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:31:20.715234 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.715154 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gvlhb\"" Jun 03 19:31:20.715234 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.715163 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:31:20.776772 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.776702 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:20.776941 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.776702 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:20.776941 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.776701 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:20.779512 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.779421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:31:20.779651 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.779627 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:31:20.779711 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.779679 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\"" Jun 03 19:31:20.779765 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.779717 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:31:20.779955 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.779936 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:31:20.780080 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.780018 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\"" Jun 03 19:31:20.784511 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.784466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.784625 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.784575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qk2\" (UniqueName: \"kubernetes.io/projected/7d8df76a-fe60-4a28-9aee-847de7169b3f-kube-api-access-54qk2\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.784686 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.784635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d8df76a-fe60-4a28-9aee-847de7169b3f-tmp-dir\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.784686 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.784662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d8df76a-fe60-4a28-9aee-847de7169b3f-config-volume\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885665 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885634 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qk2\" (UniqueName: \"kubernetes.io/projected/7d8df76a-fe60-4a28-9aee-847de7169b3f-kube-api-access-54qk2\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885839 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kms2w\" (UniqueName: \"kubernetes.io/projected/3ade2059-50ad-4972-960c-a5f959f82b1d-kube-api-access-kms2w\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.885839 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d8df76a-fe60-4a28-9aee-847de7169b3f-tmp-dir\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885839 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d8df76a-fe60-4a28-9aee-847de7169b3f-config-volume\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d8df76a-fe60-4a28-9aee-847de7169b3f-tmp-dir\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.885990 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.885954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade2059-50ad-4972-960c-a5f959f82b1d-cert\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.886123 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.886034 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:20.886123 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:20.886099 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:21.386083405 +0000 UTC m=+35.071534802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:20.886288 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.886269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d8df76a-fe60-4a28-9aee-847de7169b3f-config-volume\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.895330 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.895307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qk2\" (UniqueName: \"kubernetes.io/projected/7d8df76a-fe60-4a28-9aee-847de7169b3f-kube-api-access-54qk2\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:20.986811 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.986788 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kms2w\" (UniqueName: \"kubernetes.io/projected/3ade2059-50ad-4972-960c-a5f959f82b1d-kube-api-access-kms2w\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.986977 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.986872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade2059-50ad-4972-960c-a5f959f82b1d-cert\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.989097 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.989070 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade2059-50ad-4972-960c-a5f959f82b1d-cert\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:20.994392 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:20.994373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kms2w\" (UniqueName: \"kubernetes.io/projected/3ade2059-50ad-4972-960c-a5f959f82b1d-kube-api-access-kms2w\") pod \"ingress-canary-jrv6f\" (UID: \"3ade2059-50ad-4972-960c-a5f959f82b1d\") " pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:21.021465 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.021442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrv6f" Jun 03 19:31:21.176635 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.176608 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrv6f"] Jun 03 19:31:21.203759 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:31:21.203736 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ade2059_50ad_4972_960c_a5f959f82b1d.slice/crio-57222e238b2294e31fed98335ca4808c51e45f5b6aa6a14493ca7c0317b90776 WatchSource:0}: Error finding container 57222e238b2294e31fed98335ca4808c51e45f5b6aa6a14493ca7c0317b90776: Status 404 returned error can't find the container with id 57222e238b2294e31fed98335ca4808c51e45f5b6aa6a14493ca7c0317b90776 Jun 03 19:31:21.391014 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.390978 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:21.391163 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:21.391078 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:21.391163 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:21.391127 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:22.391113328 +0000 UTC m=+36.076564721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:21.951361 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.951326 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="2ee61b06917c2f0e01a88637a325290ca448f8e65c58bfa040d9cffd6ff565a3" exitCode=0 Jun 03 19:31:21.951921 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.951432 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"2ee61b06917c2f0e01a88637a325290ca448f8e65c58bfa040d9cffd6ff565a3"} Jun 03 19:31:21.952650 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:21.952617 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrv6f" event={"ID":"3ade2059-50ad-4972-960c-a5f959f82b1d","Type":"ContainerStarted","Data":"57222e238b2294e31fed98335ca4808c51e45f5b6aa6a14493ca7c0317b90776"} Jun 03 19:31:22.123579 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.123544 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md"] Jun 03 19:31:22.131981 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.131961 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl"] Jun 03 19:31:22.132110 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.132093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.134855 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.134696 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:31:22.134855 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.134716 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4g4d6\"" Jun 03 19:31:22.136051 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.136028 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 19:31:22.136813 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.136791 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:31:22.137070 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.137054 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:31:22.148280 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.148259 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md"] Jun 03 19:31:22.148377 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.148286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl"] Jun 03 19:31:22.148377 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.148352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.150737 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.150542 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 19:31:22.299061 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.299034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e133249-145f-4c3b-a1af-8b0e1190f721-klusterlet-config\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.299210 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.299080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djr6t\" (UniqueName: \"kubernetes.io/projected/27adec03-f551-4935-8f80-ad9f723c1a9f-kube-api-access-djr6t\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.299210 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.299146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e133249-145f-4c3b-a1af-8b0e1190f721-tmp\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.299210 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.299172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27adec03-f551-4935-8f80-ad9f723c1a9f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.299210 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.299203 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb9qq\" (UniqueName: \"kubernetes.io/projected/3e133249-145f-4c3b-a1af-8b0e1190f721-kube-api-access-vb9qq\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.400455 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e133249-145f-4c3b-a1af-8b0e1190f721-klusterlet-config\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djr6t\" (UniqueName: \"kubernetes.io/projected/27adec03-f551-4935-8f80-ad9f723c1a9f-kube-api-access-djr6t\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e133249-145f-4c3b-a1af-8b0e1190f721-tmp\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27adec03-f551-4935-8f80-ad9f723c1a9f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:22.400593 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:22.400695 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.400681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb9qq\" (UniqueName: \"kubernetes.io/projected/3e133249-145f-4c3b-a1af-8b0e1190f721-kube-api-access-vb9qq\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.401022 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:22.400734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:24.400713945 +0000 UTC m=+38.086165339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:22.401412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.401213 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e133249-145f-4c3b-a1af-8b0e1190f721-tmp\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.405087 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.405067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27adec03-f551-4935-8f80-ad9f723c1a9f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.405180 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.405068 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e133249-145f-4c3b-a1af-8b0e1190f721-klusterlet-config\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.408858 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.408835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djr6t\" (UniqueName: \"kubernetes.io/projected/27adec03-f551-4935-8f80-ad9f723c1a9f-kube-api-access-djr6t\") pod \"managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md\" (UID: \"27adec03-f551-4935-8f80-ad9f723c1a9f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.409090 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.409069 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb9qq\" (UniqueName: \"kubernetes.io/projected/3e133249-145f-4c3b-a1af-8b0e1190f721-kube-api-access-vb9qq\") pod \"klusterlet-addon-workmgr-855576fd58-hvrcl\" (UID: \"3e133249-145f-4c3b-a1af-8b0e1190f721\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.519277 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.519217 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:31:22.523381 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.523359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:22.959365 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.959327 2557 generic.go:356] "Generic (PLEG): container finished" podID="4e2e1f10-313e-4772-9fda-51e7ab47e1ba" containerID="964d00ddaa039720ac5860558d616ea15a1dcb7d135773c976fcc0e7597c6970" exitCode=0 Jun 03 19:31:22.959945 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:22.959377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerDied","Data":"964d00ddaa039720ac5860558d616ea15a1dcb7d135773c976fcc0e7597c6970"} Jun 03 19:31:23.191797 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.191769 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl"] Jun 03 19:31:23.195518 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:31:23.195490 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e133249_145f_4c3b_a1af_8b0e1190f721.slice/crio-2de951838027d43b6d19a5524f1302d9689c11a2ea925e5671cef3aad53cd56e WatchSource:0}: Error finding container 2de951838027d43b6d19a5524f1302d9689c11a2ea925e5671cef3aad53cd56e: Status 404 returned error can't find the container with id 2de951838027d43b6d19a5524f1302d9689c11a2ea925e5671cef3aad53cd56e Jun 03 19:31:23.198968 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.198944 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md"] Jun 03 19:31:23.202400 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:31:23.202373 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27adec03_f551_4935_8f80_ad9f723c1a9f.slice/crio-b8cf9d7f1743494a82553696b5970404162122689b5407935876c5cf2773d45a WatchSource:0}: Error finding container b8cf9d7f1743494a82553696b5970404162122689b5407935876c5cf2773d45a: Status 404 returned error can't find the container with id b8cf9d7f1743494a82553696b5970404162122689b5407935876c5cf2773d45a Jun 03 19:31:23.963167 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.962971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerStarted","Data":"2de951838027d43b6d19a5524f1302d9689c11a2ea925e5671cef3aad53cd56e"} Jun 03 19:31:23.966812 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.966785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" event={"ID":"4e2e1f10-313e-4772-9fda-51e7ab47e1ba","Type":"ContainerStarted","Data":"55b56c95525dbb35672077bc7d728a5ac9376a1b64eee21c9d652464d854435b"} Jun 03 19:31:23.968493 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.968456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrv6f" event={"ID":"3ade2059-50ad-4972-960c-a5f959f82b1d","Type":"ContainerStarted","Data":"634c3f2b95384b37703a5328ab7886191491fc09879c26a1647e47a708f06720"} Jun 03 19:31:23.969713 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.969690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerStarted","Data":"b8cf9d7f1743494a82553696b5970404162122689b5407935876c5cf2773d45a"} Jun 03 19:31:23.988708 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:23.988655 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v6wtx" podStartSLOduration=9.852688918 podStartE2EDuration="37.988637544s" totalImagesPullingTime="28.135948626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:23.987187699 +0000 UTC m=+37.672639115" watchObservedRunningTime="2026-06-03 19:31:23.988637544 +0000 UTC m=+37.674088959" Jun 03 19:31:24.003401 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:24.003285 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jrv6f" podStartSLOduration=1.873733407 podStartE2EDuration="4.003266437s" totalImagesPullingTime="2.12953303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:24.002848892 +0000 UTC m=+37.688300344" watchObservedRunningTime="2026-06-03 19:31:24.003266437 +0000 UTC m=+37.688717854" Jun 03 19:31:24.416147 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:24.415582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:24.416147 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:24.415748 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:24.416147 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:24.415812 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:28.415793448 +0000 UTC m=+42.101244844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:28.446871 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:28.446826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:28.447264 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:28.446982 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:28.447264 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:28.447048 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:36.447030292 +0000 UTC m=+50.132481685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:28.982591 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:28.982557 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerStarted","Data":"0230ee0f62a10345e8e32fa79ccea72a41b737b95c10f2ed66b21e953bee445f"} Jun 03 19:31:28.997120 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:28.997053 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" podStartSLOduration=1.6722828239999998 podStartE2EDuration="6.997039211s" totalImagesPullingTime="5.324756387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:28.99628217 +0000 UTC m=+42.681733587" watchObservedRunningTime="2026-06-03 19:31:28.997039211 +0000 UTC m=+42.682490626" Jun 03 19:31:29.986341 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:29.986304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerStarted","Data":"0b450c03a076f514d55719b43048a454879613e191f51058a3e8d9297d684f16"} Jun 03 19:31:30.000414 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:30.000364 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" podStartSLOduration=2.237583727 podStartE2EDuration="8.000348798s" totalImagesPullingTime="5.762765071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:30.000186614 +0000 UTC m=+43.685638053" watchObservedRunningTime="2026-06-03 19:31:30.000348798 +0000 UTC m=+43.685800237" Jun 03 19:31:30.988543 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:30.988509 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:30.990273 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:30.990252 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:31:36.498956 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:36.498914 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:36.499357 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:36.499093 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:36.499357 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:36.499160 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:31:52.499143044 +0000 UTC m=+66.184594441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:46.945966 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:46.945937 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47tl" Jun 03 19:31:52.506100 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.506064 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:31:52.506100 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.506106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:31:52.506592 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:52.506210 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:52.506592 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:52.506269 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:32:24.50625489 +0000 UTC m=+98.191706284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:31:52.508229 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.508212 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:31:52.516433 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:52.516414 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:31:52.516535 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:31:52.516458 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:32:56.51644501 +0000 UTC m=+130.201896404 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : secret "metrics-daemon-secret" not found Jun 03 19:31:52.606611 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.606584 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:52.606744 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.606620 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:52.608863 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.608845 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:31:52.608927 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.608886 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:31:52.619677 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.619656 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:31:52.620712 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.620693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/867b41e5-9cad-41fb-825c-c25cba40d388-original-pull-secret\") pod \"global-pull-secret-syncer-74c2p\" (UID: \"867b41e5-9cad-41fb-825c-c25cba40d388\") " pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:52.630437 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.630414 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9fzh\" (UniqueName: \"kubernetes.io/projected/c0be0683-37f7-48c3-948a-43a083f1cf1e-kube-api-access-n9fzh\") pod \"network-check-target-4xfz2\" (UID: \"c0be0683-37f7-48c3-948a-43a083f1cf1e\") " pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:52.889599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.889577 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\"" Jun 03 19:31:52.897717 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.897694 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:52.899976 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:52.899961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-74c2p" Jun 03 19:31:53.027994 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:53.027958 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-74c2p"] Jun 03 19:31:53.031960 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:31:53.031931 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867b41e5_9cad_41fb_825c_c25cba40d388.slice/crio-7474d670d88fe008df561323867e2e994c2ff247da7c5dbc97396287133c5648 WatchSource:0}: Error finding container 7474d670d88fe008df561323867e2e994c2ff247da7c5dbc97396287133c5648: Status 404 returned error can't find the container with id 7474d670d88fe008df561323867e2e994c2ff247da7c5dbc97396287133c5648 Jun 03 19:31:53.041758 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:53.041735 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-74c2p" event={"ID":"867b41e5-9cad-41fb-825c-c25cba40d388","Type":"ContainerStarted","Data":"7474d670d88fe008df561323867e2e994c2ff247da7c5dbc97396287133c5648"} Jun 03 19:31:53.042699 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:53.042678 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xfz2"] Jun 03 19:31:53.046181 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:31:53.046161 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0be0683_37f7_48c3_948a_43a083f1cf1e.slice/crio-30ac8d0f6f130c5f3792bc26a256f66f2e82006845a37396d1bcda9037b0fb77 WatchSource:0}: Error finding container 30ac8d0f6f130c5f3792bc26a256f66f2e82006845a37396d1bcda9037b0fb77: Status 404 returned error can't find the container with id 30ac8d0f6f130c5f3792bc26a256f66f2e82006845a37396d1bcda9037b0fb77 Jun 03 19:31:54.045756 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:54.045716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xfz2" event={"ID":"c0be0683-37f7-48c3-948a-43a083f1cf1e","Type":"ContainerStarted","Data":"30ac8d0f6f130c5f3792bc26a256f66f2e82006845a37396d1bcda9037b0fb77"} Jun 03 19:31:58.058222 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:58.058190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xfz2" event={"ID":"c0be0683-37f7-48c3-948a-43a083f1cf1e","Type":"ContainerStarted","Data":"045eda4a6fbaa505e2e2118135bbeeef581ab3eadbd16c4248f76856929c0ae8"} Jun 03 19:31:58.058687 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:58.058331 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:31:58.059616 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:58.059593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-74c2p" event={"ID":"867b41e5-9cad-41fb-825c-c25cba40d388","Type":"ContainerStarted","Data":"8fc2a53d87a4ce112853a0383545ab47992a6c4ca5c495ada6ad8c941ee54a2c"} Jun 03 19:31:58.071967 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:58.071929 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4xfz2" podStartSLOduration=67.84925626 podStartE2EDuration="1m12.071915213s" totalImagesPullingTime="4.222658953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:58.071589262 +0000 UTC m=+71.757040690" watchObservedRunningTime="2026-06-03 19:31:58.071915213 +0000 UTC m=+71.757366629" Jun 03 19:31:58.086937 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:31:58.086899 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-74c2p" podStartSLOduration=66.844939347 podStartE2EDuration="1m11.086885526s" totalImagesPullingTime="4.241946179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:58.086870373 +0000 UTC m=+71.772321818" watchObservedRunningTime="2026-06-03 19:31:58.086885526 +0000 UTC m=+71.772336936" Jun 03 19:32:24.521542 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:32:24.521501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:32:24.521919 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:32:24.521641 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:32:24.521919 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:32:24.521716 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:33:28.521698854 +0000 UTC m=+162.207150248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:32:29.066081 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:32:29.066042 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4xfz2" Jun 03 19:32:56.529602 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:32:56.529561 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:32:56.530072 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:32:56.529711 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:32:56.530072 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:32:56.529785 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.529765221 +0000 UTC m=+252.215216614 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : secret "metrics-daemon-secret" not found Jun 03 19:33:23.710092 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:33:23.710035 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6bj5l" podUID="7d8df76a-fe60-4a28-9aee-847de7169b3f" Jun 03 19:33:23.794603 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:33:23.794565 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:33:24.303875 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:24.303842 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:33:28.546265 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:28.546181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:33:28.546663 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:33:28.546286 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:33:28.546663 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:33:28.546349 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls podName:7d8df76a-fe60-4a28-9aee-847de7169b3f nodeName:}" failed. No retries permitted until 2026-06-03 19:35:30.546335046 +0000 UTC m=+284.231786440 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls") pod "dns-default-6bj5l" (UID: "7d8df76a-fe60-4a28-9aee-847de7169b3f") : secret "dns-default-metrics-tls" not found Jun 03 19:33:29.318526 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.318473 2557 generic.go:356] "Generic (PLEG): container finished" podID="3e133249-145f-4c3b-a1af-8b0e1190f721" containerID="0b450c03a076f514d55719b43048a454879613e191f51058a3e8d9297d684f16" exitCode=1 Jun 03 19:33:29.318718 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.318550 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerDied","Data":"0b450c03a076f514d55719b43048a454879613e191f51058a3e8d9297d684f16"} Jun 03 19:33:29.318876 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.318863 2557 scope.go:117] "RemoveContainer" containerID="0b450c03a076f514d55719b43048a454879613e191f51058a3e8d9297d684f16" Jun 03 19:33:29.319860 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.319839 2557 generic.go:356] "Generic (PLEG): container finished" podID="27adec03-f551-4935-8f80-ad9f723c1a9f" containerID="0230ee0f62a10345e8e32fa79ccea72a41b737b95c10f2ed66b21e953bee445f" exitCode=255 Jun 03 19:33:29.319933 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.319892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerDied","Data":"0230ee0f62a10345e8e32fa79ccea72a41b737b95c10f2ed66b21e953bee445f"} Jun 03 19:33:29.327649 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:29.327633 2557 scope.go:117] "RemoveContainer" containerID="0230ee0f62a10345e8e32fa79ccea72a41b737b95c10f2ed66b21e953bee445f" Jun 03 19:33:30.324572 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:30.324537 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerStarted","Data":"610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4"} Jun 03 19:33:30.325028 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:30.324785 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:33:30.325426 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:30.325404 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:33:30.326286 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:30.326269 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerStarted","Data":"a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03"} Jun 03 19:33:36.778126 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:33:36.778089 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:34:42.853427 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.853392 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk"] Jun 03 19:34:42.855402 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.855387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:42.857560 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.857537 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 19:34:42.857716 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.857578 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 19:34:42.857716 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.857695 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.857886 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.857870 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cx9cx\"" Jun 03 19:34:42.858471 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.858453 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.863576 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.863553 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-xw4mh"] Jun 03 19:34:42.865353 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.865336 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:42.866624 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.866607 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk"] Jun 03 19:34:42.871172 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.871148 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vkr5g\"" Jun 03 19:34:42.871268 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.871154 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 19:34:42.871825 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.871517 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 19:34:42.871825 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.871521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.872141 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.872123 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.874627 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.874610 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 19:34:42.879439 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.879415 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-xw4mh"] Jun 03 19:34:42.953456 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.953433 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-jsdhb"] Jun 03 19:34:42.955221 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.955206 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:42.957185 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.957165 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 19:34:42.957297 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.957166 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 19:34:42.957360 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.957327 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x47dj\"" Jun 03 19:34:42.963237 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.963215 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-jsdhb"] Jun 03 19:34:42.979712 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6825f252-192e-4d9f-9c81-37397afe36fe-config\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:42.979820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bttzj\" (UniqueName: \"kubernetes.io/projected/6825f252-192e-4d9f-9c81-37397afe36fe-kube-api-access-bttzj\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:42.979820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfpl2\" (UniqueName: \"kubernetes.io/projected/8407ed06-6165-492d-9c93-8ae0cd2c82ad-kube-api-access-cfpl2\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:42.979910 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-config\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:42.979910 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979858 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6825f252-192e-4d9f-9c81-37397afe36fe-serving-cert\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:42.979910 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8407ed06-6165-492d-9c93-8ae0cd2c82ad-serving-cert\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:42.979910 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:42.979902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-trusted-ca\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.081145 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8407ed06-6165-492d-9c93-8ae0cd2c82ad-serving-cert\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.081145 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-trusted-ca\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081168 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-nginx-conf\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6825f252-192e-4d9f-9c81-37397afe36fe-config\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bttzj\" (UniqueName: \"kubernetes.io/projected/6825f252-192e-4d9f-9c81-37397afe36fe-kube-api-access-bttzj\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfpl2\" (UniqueName: \"kubernetes.io/projected/8407ed06-6165-492d-9c93-8ae0cd2c82ad-kube-api-access-cfpl2\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.081379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-config\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.081725 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081396 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6825f252-192e-4d9f-9c81-37397afe36fe-serving-cert\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.081910 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.081880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6825f252-192e-4d9f-9c81-37397afe36fe-config\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.082080 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.082061 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-config\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.082252 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.082233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8407ed06-6165-492d-9c93-8ae0cd2c82ad-trusted-ca\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.083541 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.083516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6825f252-192e-4d9f-9c81-37397afe36fe-serving-cert\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.083662 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.083634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8407ed06-6165-492d-9c93-8ae0cd2c82ad-serving-cert\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.088515 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.088489 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bttzj\" (UniqueName: \"kubernetes.io/projected/6825f252-192e-4d9f-9c81-37397afe36fe-kube-api-access-bttzj\") pod \"service-ca-operator-5bc4cf794b-9dpfk\" (UID: \"6825f252-192e-4d9f-9c81-37397afe36fe\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.088741 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.088719 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfpl2\" (UniqueName: \"kubernetes.io/projected/8407ed06-6165-492d-9c93-8ae0cd2c82ad-kube-api-access-cfpl2\") pod \"console-operator-85bd8fd97d-xw4mh\" (UID: \"8407ed06-6165-492d-9c93-8ae0cd2c82ad\") " pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.164788 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.164723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" Jun 03 19:34:43.174677 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.174652 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:43.182541 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.182518 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-nginx-conf\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.182650 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.182559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.182713 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:43.182674 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:43.182768 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:43.182736 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.682717748 +0000 UTC m=+237.368169142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:34:43.183188 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.183168 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-nginx-conf\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.291126 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.291065 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk"] Jun 03 19:34:43.294638 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:34:43.294610 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6825f252_192e_4d9f_9c81_37397afe36fe.slice/crio-39d2a1b98dbcbd5003210dac4cc2fdbc98749fa1510a8d8afbebeffd86b7654a WatchSource:0}: Error finding container 39d2a1b98dbcbd5003210dac4cc2fdbc98749fa1510a8d8afbebeffd86b7654a: Status 404 returned error can't find the container with id 39d2a1b98dbcbd5003210dac4cc2fdbc98749fa1510a8d8afbebeffd86b7654a Jun 03 19:34:43.307014 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.306991 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-xw4mh"] Jun 03 19:34:43.309553 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:34:43.309526 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8407ed06_6165_492d_9c93_8ae0cd2c82ad.slice/crio-c23b2487cab862abbc6942eeef7ce57d9c2bbe2e2453d1552ec0d8e491bafa73 WatchSource:0}: Error finding container c23b2487cab862abbc6942eeef7ce57d9c2bbe2e2453d1552ec0d8e491bafa73: Status 404 returned error can't find the container with id c23b2487cab862abbc6942eeef7ce57d9c2bbe2e2453d1552ec0d8e491bafa73 Jun 03 19:34:43.523546 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.523436 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" event={"ID":"8407ed06-6165-492d-9c93-8ae0cd2c82ad","Type":"ContainerStarted","Data":"c23b2487cab862abbc6942eeef7ce57d9c2bbe2e2453d1552ec0d8e491bafa73"} Jun 03 19:34:43.524503 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.524458 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" event={"ID":"6825f252-192e-4d9f-9c81-37397afe36fe","Type":"ContainerStarted","Data":"39d2a1b98dbcbd5003210dac4cc2fdbc98749fa1510a8d8afbebeffd86b7654a"} Jun 03 19:34:43.686888 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:43.686856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:43.687031 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:43.686999 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:43.687078 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:43.687061 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.687047501 +0000 UTC m=+238.372498895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:34:44.693174 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:44.693127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:44.693566 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:44.693274 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:44.693566 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:44.693338 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.693322153 +0000 UTC m=+240.378773547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:34:46.536243 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.536221 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/0.log" Jun 03 19:34:46.536665 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.536261 2557 generic.go:356] "Generic (PLEG): container finished" podID="8407ed06-6165-492d-9c93-8ae0cd2c82ad" containerID="e2848fff54eecc0bdd59a0d072efdba6ddff11644e792e62fc2f77d0b32b57c8" exitCode=255 Jun 03 19:34:46.536665 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.536340 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" event={"ID":"8407ed06-6165-492d-9c93-8ae0cd2c82ad","Type":"ContainerDied","Data":"e2848fff54eecc0bdd59a0d072efdba6ddff11644e792e62fc2f77d0b32b57c8"} Jun 03 19:34:46.536665 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.536590 2557 scope.go:117] "RemoveContainer" containerID="e2848fff54eecc0bdd59a0d072efdba6ddff11644e792e62fc2f77d0b32b57c8" Jun 03 19:34:46.537763 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.537739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" event={"ID":"6825f252-192e-4d9f-9c81-37397afe36fe","Type":"ContainerStarted","Data":"a5ba64004d5e73d030e30b23914bab447c534a7079a7b9e5b6b1673b5850e0bf"} Jun 03 19:34:46.565722 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.565682 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" podStartSLOduration=1.83112294 podStartE2EDuration="4.56566836s" totalImagesPullingTime="2.73454542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:46.564646046 +0000 UTC m=+240.250097473" watchObservedRunningTime="2026-06-03 19:34:46.56566836 +0000 UTC m=+240.251119775" Jun 03 19:34:46.710038 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.710007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:46.710227 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:46.710195 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:46.710313 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:46.710259 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.710241922 +0000 UTC m=+244.395693318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:34:46.840957 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.840885 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv"] Jun 03 19:34:46.846387 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.846352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" Jun 03 19:34:46.849442 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.849416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t2k85\"" Jun 03 19:34:46.849442 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.849429 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:46.849619 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.849431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 19:34:46.853822 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:46.853603 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv"] Jun 03 19:34:47.011718 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.011690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvfj\" (UniqueName: \"kubernetes.io/projected/2236ac9c-1e8c-4052-9e91-80c349bebabc-kube-api-access-wqvfj\") pod \"migrator-955ffdf5f-mnzwv\" (UID: \"2236ac9c-1e8c-4052-9e91-80c349bebabc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" Jun 03 19:34:47.112181 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.112156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvfj\" (UniqueName: \"kubernetes.io/projected/2236ac9c-1e8c-4052-9e91-80c349bebabc-kube-api-access-wqvfj\") pod \"migrator-955ffdf5f-mnzwv\" (UID: \"2236ac9c-1e8c-4052-9e91-80c349bebabc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" Jun 03 19:34:47.119827 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.119801 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvfj\" (UniqueName: \"kubernetes.io/projected/2236ac9c-1e8c-4052-9e91-80c349bebabc-kube-api-access-wqvfj\") pod \"migrator-955ffdf5f-mnzwv\" (UID: \"2236ac9c-1e8c-4052-9e91-80c349bebabc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" Jun 03 19:34:47.156230 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.156202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" Jun 03 19:34:47.278881 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.278855 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv"] Jun 03 19:34:47.282533 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:34:47.282505 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2236ac9c_1e8c_4052_9e91_80c349bebabc.slice/crio-98cf0a8846083c6f61af2498201c751ac4ad5072d6150afef6315271a14b08f6 WatchSource:0}: Error finding container 98cf0a8846083c6f61af2498201c751ac4ad5072d6150afef6315271a14b08f6: Status 404 returned error can't find the container with id 98cf0a8846083c6f61af2498201c751ac4ad5072d6150afef6315271a14b08f6 Jun 03 19:34:47.541612 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.541518 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" event={"ID":"2236ac9c-1e8c-4052-9e91-80c349bebabc","Type":"ContainerStarted","Data":"98cf0a8846083c6f61af2498201c751ac4ad5072d6150afef6315271a14b08f6"} Jun 03 19:34:47.543053 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543033 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:34:47.543401 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543387 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/0.log" Jun 03 19:34:47.543497 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543418 2557 generic.go:356] "Generic (PLEG): container finished" podID="8407ed06-6165-492d-9c93-8ae0cd2c82ad" containerID="5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7" exitCode=255 Jun 03 19:34:47.543497 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" event={"ID":"8407ed06-6165-492d-9c93-8ae0cd2c82ad","Type":"ContainerDied","Data":"5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7"} Jun 03 19:34:47.543594 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543520 2557 scope.go:117] "RemoveContainer" containerID="e2848fff54eecc0bdd59a0d072efdba6ddff11644e792e62fc2f77d0b32b57c8" Jun 03 19:34:47.543822 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:47.543809 2557 scope.go:117] "RemoveContainer" containerID="5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7" Jun 03 19:34:47.543975 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:47.543947 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-xw4mh_openshift-console-operator(8407ed06-6165-492d-9c93-8ae0cd2c82ad)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" podUID="8407ed06-6165-492d-9c93-8ae0cd2c82ad" Jun 03 19:34:48.549861 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:48.549837 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:34:48.550225 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:48.550205 2557 scope.go:117] "RemoveContainer" containerID="5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7" Jun 03 19:34:48.550390 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:48.550366 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-xw4mh_openshift-console-operator(8407ed06-6165-492d-9c93-8ae0cd2c82ad)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" podUID="8407ed06-6165-492d-9c93-8ae0cd2c82ad" Jun 03 19:34:49.557341 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:49.557304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" event={"ID":"2236ac9c-1e8c-4052-9e91-80c349bebabc","Type":"ContainerStarted","Data":"47c9e03abb43b0e343ec26b10f03d5f489e8df53e669d41665e2e665780b9b50"} Jun 03 19:34:49.557746 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:49.557369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" event={"ID":"2236ac9c-1e8c-4052-9e91-80c349bebabc","Type":"ContainerStarted","Data":"f5d8e6bb6330b5cca1db418c0aefdfeb711db83d8c4565143d005b7075736a7e"} Jun 03 19:34:49.572490 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:49.572433 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mnzwv" podStartSLOduration=2.361312845 podStartE2EDuration="3.572416344s" totalImagesPullingTime="1.211103499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:49.570490723 +0000 UTC m=+243.255942130" watchObservedRunningTime="2026-06-03 19:34:49.572416344 +0000 UTC m=+243.257867760" Jun 03 19:34:50.132724 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:50.132698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cnqgg_2aad1e08-59f9-4f3c-ba3f-406de123624c/dns-node-resolver/0.log" Jun 03 19:34:50.739428 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:50.739389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:50.739844 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:50.739546 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:50.739844 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:50.739606 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.739589415 +0000 UTC m=+252.425040825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:34:51.333249 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:51.333219 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vg85g_a9a78be6-3c36-4274-ba07-08c18b84e659/node-ca/0.log" Jun 03 19:34:51.733121 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:51.733086 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jrv6f_3ade2059-50ad-4972-960c-a5f959f82b1d/serve-healthcheck-canary/0.log" Jun 03 19:34:52.333371 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:52.333336 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mnzwv_2236ac9c-1e8c-4052-9e91-80c349bebabc/migrator/0.log" Jun 03 19:34:52.532234 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:52.532204 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mnzwv_2236ac9c-1e8c-4052-9e91-80c349bebabc/graceful-termination/0.log" Jun 03 19:34:53.174854 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:53.174774 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:53.174854 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:53.174830 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:34:53.175153 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:53.175140 2557 scope.go:117] "RemoveContainer" containerID="5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7" Jun 03 19:34:53.175308 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:53.175290 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-xw4mh_openshift-console-operator(8407ed06-6165-492d-9c93-8ae0cd2c82ad)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" podUID="8407ed06-6165-492d-9c93-8ae0cd2c82ad" Jun 03 19:34:58.596456 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:58.596371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:34:58.596838 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:58.596526 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:34:58.596838 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:58.596597 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs podName:1dbf39bc-d077-40f8-83c9-42e0b08dc9fd nodeName:}" failed. No retries permitted until 2026-06-03 19:37:00.596580107 +0000 UTC m=+374.282031504 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs") pod "network-metrics-daemon-z5vhs" (UID: "1dbf39bc-d077-40f8-83c9-42e0b08dc9fd") : secret "metrics-daemon-secret" not found Jun 03 19:34:58.797488 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:34:58.797454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:34:58.797667 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:58.797558 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:34:58.797667 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:34:58.797622 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert podName:b9b3c532-9845-4fd8-9507-d5f3b05ddc49 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:14.797604448 +0000 UTC m=+268.483055843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-jsdhb" (UID: "b9b3c532-9845-4fd8-9507-d5f3b05ddc49") : secret "networking-console-plugin-cert" not found Jun 03 19:35:08.777639 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:08.777606 2557 scope.go:117] "RemoveContainer" containerID="5ab2a67e43c1cfe4f044a1fac4f63c8af3067b7b299204dd4177cab5937826d7" Jun 03 19:35:09.616523 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:09.616495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:35:09.616688 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:09.616577 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" event={"ID":"8407ed06-6165-492d-9c93-8ae0cd2c82ad","Type":"ContainerStarted","Data":"b8d74e1f9d56cd0b8236aa4028064a8c406d6d3650f8a51ffd4ad73256c9b5c2"} Jun 03 19:35:09.616866 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:09.616848 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:35:09.632995 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:09.632944 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" podStartSLOduration=24.916792877 podStartE2EDuration="27.632928362s" totalImagesPullingTime="2.716135485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:09.631677893 +0000 UTC m=+263.317129309" watchObservedRunningTime="2026-06-03 19:35:09.632928362 +0000 UTC m=+263.318379779" Jun 03 19:35:09.671182 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:09.671152 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-xw4mh" Jun 03 19:35:12.155053 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.155024 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4gxgf"] Jun 03 19:35:12.157216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.157193 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.159579 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.159554 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:35:12.159683 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.159625 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:35:12.160534 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.160513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:35:12.160616 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.160545 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:35:12.160675 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.160609 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkz7f\"" Jun 03 19:35:12.178163 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.178139 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gxgf"] Jun 03 19:35:12.193448 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.193423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc1a65d-2c1d-4646-acbe-748dbd907a94-data-volume\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.193598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.193509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bc1a65d-2c1d-4646-acbe-748dbd907a94-crio-socket\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.193598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.193550 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bc1a65d-2c1d-4646-acbe-748dbd907a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.193598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.193577 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.193598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.193593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkjwd\" (UniqueName: \"kubernetes.io/projected/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-api-access-jkjwd\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.228710 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.228656 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f65648f66-pjx8c"] Jun 03 19:35:12.230743 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.230728 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.233160 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.233141 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:35:12.233160 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.233149 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:35:12.233338 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.233219 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:35:12.233338 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.233314 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tr6t\"" Jun 03 19:35:12.238326 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.238287 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:35:12.244672 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.244648 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f65648f66-pjx8c"] Jun 03 19:35:12.294839 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294806 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bc1a65d-2c1d-4646-acbe-748dbd907a94-crio-socket\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bc1a65d-2c1d-4646-acbe-748dbd907a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swbqf\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-kube-api-access-swbqf\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294894 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-image-registry-private-configuration\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bc1a65d-2c1d-4646-acbe-748dbd907a94-crio-socket\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.294997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.294978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-registry-certificates\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-registry-tls\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06784d9f-eb4d-476b-871c-9531654eb571-ca-trust-extracted\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-installation-pull-secrets\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295126 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-bound-sa-token\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-trusted-ca\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.295192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkjwd\" (UniqueName: \"kubernetes.io/projected/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-api-access-jkjwd\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.295445 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc1a65d-2c1d-4646-acbe-748dbd907a94-data-volume\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.295445 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295440 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc1a65d-2c1d-4646-acbe-748dbd907a94-data-volume\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.295588 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.295462 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.297308 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.297281 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bc1a65d-2c1d-4646-acbe-748dbd907a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.305667 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.305647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkjwd\" (UniqueName: \"kubernetes.io/projected/1bc1a65d-2c1d-4646-acbe-748dbd907a94-kube-api-access-jkjwd\") pod \"insights-runtime-extractor-4gxgf\" (UID: \"1bc1a65d-2c1d-4646-acbe-748dbd907a94\") " pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.395968 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.395935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swbqf\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-kube-api-access-swbqf\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.395968 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.395968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-image-registry-private-configuration\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-registry-certificates\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396060 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-registry-tls\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06784d9f-eb4d-476b-871c-9531654eb571-ca-trust-extracted\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-installation-pull-secrets\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396130 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-bound-sa-token\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396161 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396155 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-trusted-ca\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396657 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06784d9f-eb4d-476b-871c-9531654eb571-ca-trust-extracted\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.396998 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.396973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-registry-certificates\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.397209 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.397188 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06784d9f-eb4d-476b-871c-9531654eb571-trusted-ca\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.398807 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.398782 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-installation-pull-secrets\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.398897 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.398845 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-registry-tls\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.398962 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.398941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06784d9f-eb4d-476b-871c-9531654eb571-image-registry-private-configuration\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.405773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.405713 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swbqf\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-kube-api-access-swbqf\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.406012 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.405992 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06784d9f-eb4d-476b-871c-9531654eb571-bound-sa-token\") pod \"image-registry-6f65648f66-pjx8c\" (UID: \"06784d9f-eb4d-476b-871c-9531654eb571\") " pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.467129 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.467101 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gxgf" Jun 03 19:35:12.540945 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.540915 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:12.598014 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.597890 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gxgf"] Jun 03 19:35:12.602550 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:35:12.602524 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc1a65d_2c1d_4646_acbe_748dbd907a94.slice/crio-f949d3c392b1c1dc6ef2125d8d2975db00fdcf5882bc15a4f78b6972176b79df WatchSource:0}: Error finding container f949d3c392b1c1dc6ef2125d8d2975db00fdcf5882bc15a4f78b6972176b79df: Status 404 returned error can't find the container with id f949d3c392b1c1dc6ef2125d8d2975db00fdcf5882bc15a4f78b6972176b79df Jun 03 19:35:12.627641 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.627609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gxgf" event={"ID":"1bc1a65d-2c1d-4646-acbe-748dbd907a94","Type":"ContainerStarted","Data":"f949d3c392b1c1dc6ef2125d8d2975db00fdcf5882bc15a4f78b6972176b79df"} Jun 03 19:35:12.684454 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:12.684425 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f65648f66-pjx8c"] Jun 03 19:35:12.689190 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:35:12.689160 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06784d9f_eb4d_476b_871c_9531654eb571.slice/crio-851db953699f9443f6c08460fbc056ca03b9ea39cb171400efd7886ee07edf6b WatchSource:0}: Error finding container 851db953699f9443f6c08460fbc056ca03b9ea39cb171400efd7886ee07edf6b: Status 404 returned error can't find the container with id 851db953699f9443f6c08460fbc056ca03b9ea39cb171400efd7886ee07edf6b Jun 03 19:35:13.632438 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.632405 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gxgf" event={"ID":"1bc1a65d-2c1d-4646-acbe-748dbd907a94","Type":"ContainerStarted","Data":"e9982002feeb110a029d0ae04810bbd7842237dd42fed9b5b077197eeef1c5a7"} Jun 03 19:35:13.632893 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.632463 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gxgf" event={"ID":"1bc1a65d-2c1d-4646-acbe-748dbd907a94","Type":"ContainerStarted","Data":"edaee444154e2ffea40cbe9a3ecd019259c284bb45e13c93815e26b1cc0fb978"} Jun 03 19:35:13.633693 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.633676 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" event={"ID":"06784d9f-eb4d-476b-871c-9531654eb571","Type":"ContainerStarted","Data":"35b67172c860772f3aa43fcea66def6051efc7ae3aed3c5cf0237f7d864a80a3"} Jun 03 19:35:13.633772 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.633706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" event={"ID":"06784d9f-eb4d-476b-871c-9531654eb571","Type":"ContainerStarted","Data":"851db953699f9443f6c08460fbc056ca03b9ea39cb171400efd7886ee07edf6b"} Jun 03 19:35:13.633823 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.633807 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:13.653492 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:13.653421 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" podStartSLOduration=1.653400508 podStartE2EDuration="1.653400508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:13.651637435 +0000 UTC m=+267.337088843" watchObservedRunningTime="2026-06-03 19:35:13.653400508 +0000 UTC m=+267.338851925" Jun 03 19:35:14.816302 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:14.816265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:35:14.818862 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:14.818830 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b3c532-9845-4fd8-9507-d5f3b05ddc49-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-jsdhb\" (UID: \"b9b3c532-9845-4fd8-9507-d5f3b05ddc49\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:35:15.066412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.066348 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x47dj\"" Jun 03 19:35:15.074138 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.074122 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" Jun 03 19:35:15.195060 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.195030 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-jsdhb"] Jun 03 19:35:15.641583 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.641540 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" event={"ID":"b9b3c532-9845-4fd8-9507-d5f3b05ddc49","Type":"ContainerStarted","Data":"006df0ee152ab079a9d73e59651a5fdc40f9968ab22970570a26841f32f001ff"} Jun 03 19:35:15.643303 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.643283 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gxgf" event={"ID":"1bc1a65d-2c1d-4646-acbe-748dbd907a94","Type":"ContainerStarted","Data":"62c5e6991908b43e05aaaf160c482f8e33a0de98a2cc97844a1d0b074ad50b59"} Jun 03 19:35:15.662752 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:15.662702 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4gxgf" podStartSLOduration=1.415045975 podStartE2EDuration="3.66268697s" totalImagesPullingTime="2.247640995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:15.661167502 +0000 UTC m=+269.346618929" watchObservedRunningTime="2026-06-03 19:35:15.66268697 +0000 UTC m=+269.348138385" Jun 03 19:35:16.650404 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:16.650367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" event={"ID":"b9b3c532-9845-4fd8-9507-d5f3b05ddc49","Type":"ContainerStarted","Data":"219c12bbcffc21354b892fb290fff259808da81fd0b2a17bb41680da33066555"} Jun 03 19:35:16.668227 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:16.668180 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-jsdhb" podStartSLOduration=33.38086231 podStartE2EDuration="34.668165164s" totalImagesPullingTime="1.287302854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:16.66657924 +0000 UTC m=+270.352030669" watchObservedRunningTime="2026-06-03 19:35:16.668165164 +0000 UTC m=+270.353616581" Jun 03 19:35:27.305017 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:27.304966 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6bj5l" podUID="7d8df76a-fe60-4a28-9aee-847de7169b3f" Jun 03 19:35:27.685156 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:27.685127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:29.693445 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.693351 2557 generic.go:356] "Generic (PLEG): container finished" podID="3e133249-145f-4c3b-a1af-8b0e1190f721" containerID="610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4" exitCode=1 Jun 03 19:35:29.693445 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.693430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerDied","Data":"610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4"} Jun 03 19:35:29.693970 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.693514 2557 scope.go:117] "RemoveContainer" containerID="0b450c03a076f514d55719b43048a454879613e191f51058a3e8d9297d684f16" Jun 03 19:35:29.693970 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.693876 2557 scope.go:117] "RemoveContainer" containerID="610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4" Jun 03 19:35:29.694085 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:29.694060 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-855576fd58-hvrcl_open-cluster-management-agent-addon(3e133249-145f-4c3b-a1af-8b0e1190f721)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" podUID="3e133249-145f-4c3b-a1af-8b0e1190f721" Jun 03 19:35:29.695320 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.695301 2557 generic.go:356] "Generic (PLEG): container finished" podID="27adec03-f551-4935-8f80-ad9f723c1a9f" containerID="a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03" exitCode=255 Jun 03 19:35:29.695434 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.695327 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerDied","Data":"a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03"} Jun 03 19:35:29.701909 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.701891 2557 scope.go:117] "RemoveContainer" containerID="a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03" Jun 03 19:35:29.702042 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:29.702025 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md_open-cluster-management-agent-addon(27adec03-f551-4935-8f80-ad9f723c1a9f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" podUID="27adec03-f551-4935-8f80-ad9f723c1a9f" Jun 03 19:35:29.702937 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:29.702918 2557 scope.go:117] "RemoveContainer" containerID="0230ee0f62a10345e8e32fa79ccea72a41b737b95c10f2ed66b21e953bee445f" Jun 03 19:35:30.325259 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.325224 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:35:30.647122 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.647088 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:30.649379 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.649349 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d8df76a-fe60-4a28-9aee-847de7169b3f-metrics-tls\") pod \"dns-default-6bj5l\" (UID: \"7d8df76a-fe60-4a28-9aee-847de7169b3f\") " pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:30.688913 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.688884 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\"" Jun 03 19:35:30.696592 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.696567 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:30.700143 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.700119 2557 scope.go:117] "RemoveContainer" containerID="610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4" Jun 03 19:35:30.700328 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:30.700308 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-855576fd58-hvrcl_open-cluster-management-agent-addon(3e133249-145f-4c3b-a1af-8b0e1190f721)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" podUID="3e133249-145f-4c3b-a1af-8b0e1190f721" Jun 03 19:35:30.815612 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:30.815581 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6bj5l"] Jun 03 19:35:30.818668 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:35:30.818645 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8df76a_fe60_4a28_9aee_847de7169b3f.slice/crio-0acf81806669cad9beb9e0b3fd15a18246f5bcf92ee67a61100c0866b62a6190 WatchSource:0}: Error finding container 0acf81806669cad9beb9e0b3fd15a18246f5bcf92ee67a61100c0866b62a6190: Status 404 returned error can't find the container with id 0acf81806669cad9beb9e0b3fd15a18246f5bcf92ee67a61100c0866b62a6190 Jun 03 19:35:31.706272 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:31.706236 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj5l" event={"ID":"7d8df76a-fe60-4a28-9aee-847de7169b3f","Type":"ContainerStarted","Data":"0acf81806669cad9beb9e0b3fd15a18246f5bcf92ee67a61100c0866b62a6190"} Jun 03 19:35:32.520286 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.520199 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" Jun 03 19:35:32.520598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.520581 2557 scope.go:117] "RemoveContainer" containerID="a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03" Jun 03 19:35:32.520775 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:32.520755 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md_open-cluster-management-agent-addon(27adec03-f551-4935-8f80-ad9f723c1a9f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" podUID="27adec03-f551-4935-8f80-ad9f723c1a9f" Jun 03 19:35:32.523628 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.523605 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:35:32.523894 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.523882 2557 scope.go:117] "RemoveContainer" containerID="610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4" Jun 03 19:35:32.524015 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:32.523998 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-855576fd58-hvrcl_open-cluster-management-agent-addon(3e133249-145f-4c3b-a1af-8b0e1190f721)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" podUID="3e133249-145f-4c3b-a1af-8b0e1190f721" Jun 03 19:35:32.547029 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.546991 2557 patch_prober.go:28] interesting pod/image-registry-6f65648f66-pjx8c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:35:32.547134 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.547044 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" podUID="06784d9f-eb4d-476b-871c-9531654eb571" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:35:32.710743 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.710703 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj5l" event={"ID":"7d8df76a-fe60-4a28-9aee-847de7169b3f","Type":"ContainerStarted","Data":"5db1330a7b2eb7e2a5deeb898912d08196ca258f1d8c2a0bd05dc4d3d97c1890"} Jun 03 19:35:32.711215 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.710797 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj5l" event={"ID":"7d8df76a-fe60-4a28-9aee-847de7169b3f","Type":"ContainerStarted","Data":"a7abd0536af6996f376dd29c610be35ac6c91dcf24b7368b1d1d98ad733c0229"} Jun 03 19:35:32.711215 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.710850 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:32.733894 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:32.733841 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6bj5l" podStartSLOduration=251.364193513 podStartE2EDuration="4m12.733825553s" totalImagesPullingTime="1.36963204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:32.732635074 +0000 UTC m=+286.418086492" watchObservedRunningTime="2026-06-03 19:35:32.733825553 +0000 UTC m=+286.419276968" Jun 03 19:35:33.006663 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.006627 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9"] Jun 03 19:35:33.009981 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.009961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.012128 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012101 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 19:35:33.012310 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012178 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:35:33.012310 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012178 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 19:35:33.012436 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012409 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:35:33.012436 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012420 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qccrh\"" Jun 03 19:35:33.012539 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.012454 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:35:33.020236 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.020205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9"] Jun 03 19:35:33.052753 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.052724 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tq49h"] Jun 03 19:35:33.055784 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.055768 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.057965 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.057944 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:35:33.058079 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.057999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgvtv\"" Jun 03 19:35:33.058254 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.058239 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:35:33.058327 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.058270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:35:33.167300 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-root\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.167469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-sys\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-textfile\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-tls\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167464 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-wtmp\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167498 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167517 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61240c-3d94-4c43-98e4-feeb9971662d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-metrics-client-ca\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96dx\" (UniqueName: \"kubernetes.io/projected/ddda9dec-a0e0-4c4c-b024-1925692a4e49-kube-api-access-t96dx\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdgx\" (UniqueName: \"kubernetes.io/projected/ac61240c-3d94-4c43-98e4-feeb9971662d-kube-api-access-njdgx\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.167805 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.167756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.269150 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269057 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.269150 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-sys\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269150 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-textfile\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-tls\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-wtmp\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269192 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-sys\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269284 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269326 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-wtmp\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61240c-3d94-4c43-98e4-feeb9971662d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.269412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-metrics-client-ca\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96dx\" (UniqueName: \"kubernetes.io/projected/ddda9dec-a0e0-4c4c-b024-1925692a4e49-kube-api-access-t96dx\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njdgx\" (UniqueName: \"kubernetes.io/projected/ac61240c-3d94-4c43-98e4-feeb9971662d-kube-api-access-njdgx\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269536 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-textfile\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-root\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.269846 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.269677 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddda9dec-a0e0-4c4c-b024-1925692a4e49-root\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.270148 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.270122 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61240c-3d94-4c43-98e4-feeb9971662d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.270204 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.270182 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-metrics-client-ca\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.270599 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.270577 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.271740 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.271714 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-tls\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.271886 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.271869 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.272081 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.272066 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddda9dec-a0e0-4c4c-b024-1925692a4e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.272179 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.272158 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac61240c-3d94-4c43-98e4-feeb9971662d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.276199 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.276176 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdgx\" (UniqueName: \"kubernetes.io/projected/ac61240c-3d94-4c43-98e4-feeb9971662d-kube-api-access-njdgx\") pod \"openshift-state-metrics-65f78d5c66-qbvq9\" (UID: \"ac61240c-3d94-4c43-98e4-feeb9971662d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.276331 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.276310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96dx\" (UniqueName: \"kubernetes.io/projected/ddda9dec-a0e0-4c4c-b024-1925692a4e49-kube-api-access-t96dx\") pod \"node-exporter-tq49h\" (UID: \"ddda9dec-a0e0-4c4c-b024-1925692a4e49\") " pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.338015 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.337988 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" Jun 03 19:35:33.364205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.364176 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tq49h" Jun 03 19:35:33.374796 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:35:33.374768 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddda9dec_a0e0_4c4c_b024_1925692a4e49.slice/crio-1bc860448ecdf08679bf9ec1538d339bdea88d1027c26aba2f08885a72db409f WatchSource:0}: Error finding container 1bc860448ecdf08679bf9ec1538d339bdea88d1027c26aba2f08885a72db409f: Status 404 returned error can't find the container with id 1bc860448ecdf08679bf9ec1538d339bdea88d1027c26aba2f08885a72db409f Jun 03 19:35:33.469123 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.469100 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9"] Jun 03 19:35:33.471338 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:35:33.471318 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac61240c_3d94_4c43_98e4_feeb9971662d.slice/crio-a95ae747ddf5c644856648ab224d769f60cf40243624eb1e926c27444f0efb13 WatchSource:0}: Error finding container a95ae747ddf5c644856648ab224d769f60cf40243624eb1e926c27444f0efb13: Status 404 returned error can't find the container with id a95ae747ddf5c644856648ab224d769f60cf40243624eb1e926c27444f0efb13 Jun 03 19:35:33.717363 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.717322 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq49h" event={"ID":"ddda9dec-a0e0-4c4c-b024-1925692a4e49","Type":"ContainerStarted","Data":"1bc860448ecdf08679bf9ec1538d339bdea88d1027c26aba2f08885a72db409f"} Jun 03 19:35:33.719077 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.719051 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" event={"ID":"ac61240c-3d94-4c43-98e4-feeb9971662d","Type":"ContainerStarted","Data":"1eb5122fa023b7e9ee28a3719f15b26696833a4e0cfca994bbebbb1e6d7d76cb"} Jun 03 19:35:33.719214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.719099 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" event={"ID":"ac61240c-3d94-4c43-98e4-feeb9971662d","Type":"ContainerStarted","Data":"957c00ce24daccbda13f713818cfba25f4de8996931bdd608895227952bdb8ba"} Jun 03 19:35:33.719214 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:33.719119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" event={"ID":"ac61240c-3d94-4c43-98e4-feeb9971662d","Type":"ContainerStarted","Data":"a95ae747ddf5c644856648ab224d769f60cf40243624eb1e926c27444f0efb13"} Jun 03 19:35:34.641495 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:34.641453 2557 patch_prober.go:28] interesting pod/image-registry-6f65648f66-pjx8c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:35:34.641613 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:34.641525 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" podUID="06784d9f-eb4d-476b-871c-9531654eb571" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:35:34.724145 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:34.724109 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq49h" event={"ID":"ddda9dec-a0e0-4c4c-b024-1925692a4e49","Type":"ContainerStarted","Data":"a3e06f639eba715b09638bf35b77468a5d1e5641903dba40620ffab79980b757"} Jun 03 19:35:34.726310 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:34.726287 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" event={"ID":"ac61240c-3d94-4c43-98e4-feeb9971662d","Type":"ContainerStarted","Data":"648c70c91a25d88aa9eae5cb164bfb6059796ebcab2970ed459a915982dc78f2"} Jun 03 19:35:34.755553 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:34.755487 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbvq9" podStartSLOduration=1.7666320309999999 podStartE2EDuration="2.755453005s" totalImagesPullingTime="988.820974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:34.754730923 +0000 UTC m=+288.440182339" watchObservedRunningTime="2026-06-03 19:35:34.755453005 +0000 UTC m=+288.440904421" Jun 03 19:35:35.731408 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:35.731374 2557 generic.go:356] "Generic (PLEG): container finished" podID="ddda9dec-a0e0-4c4c-b024-1925692a4e49" containerID="a3e06f639eba715b09638bf35b77468a5d1e5641903dba40620ffab79980b757" exitCode=0 Jun 03 19:35:35.731859 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:35.731472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq49h" event={"ID":"ddda9dec-a0e0-4c4c-b024-1925692a4e49","Type":"ContainerDied","Data":"a3e06f639eba715b09638bf35b77468a5d1e5641903dba40620ffab79980b757"} Jun 03 19:35:36.736891 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:36.736853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq49h" event={"ID":"ddda9dec-a0e0-4c4c-b024-1925692a4e49","Type":"ContainerStarted","Data":"0ba118b3af5a1d3c4c7ae6b84742b0c93264401de1630e85421702d3ac55ac59"} Jun 03 19:35:36.737251 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:36.736902 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq49h" event={"ID":"ddda9dec-a0e0-4c4c-b024-1925692a4e49","Type":"ContainerStarted","Data":"7a1cc6e75ecf77217b65bb62404d08e5cf7f055556660e3da56e6822b57fa63b"} Jun 03 19:35:36.759757 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:36.759713 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tq49h" podStartSLOduration=2.477030197 podStartE2EDuration="3.759696622s" totalImagesPullingTime="1.210978645s" totalInitContainerRuntime="71.68778ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:36.758343444 +0000 UTC m=+290.443794871" watchObservedRunningTime="2026-06-03 19:35:36.759696622 +0000 UTC m=+290.445148037" Jun 03 19:35:39.779157 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:35:39.779098 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z5vhs" podUID="1dbf39bc-d077-40f8-83c9-42e0b08dc9fd" Jun 03 19:35:42.545867 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:42.545826 2557 patch_prober.go:28] interesting pod/image-registry-6f65648f66-pjx8c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:35:42.546287 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:42.545883 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" podUID="06784d9f-eb4d-476b-871c-9531654eb571" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:35:42.721540 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:42.721510 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6bj5l" Jun 03 19:35:44.641590 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:44.641564 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f65648f66-pjx8c" Jun 03 19:35:46.725014 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.724986 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:35:46.725424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.724989 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:35:46.733552 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.733527 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:35:46.733552 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.733549 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:35:46.736636 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.736619 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:35:46.778444 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:46.778320 2557 scope.go:117] "RemoveContainer" containerID="610932f5fe35b869c0140c5f0cf76415fd5592a030052edb928a651f203446c4" Jun 03 19:35:47.775452 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:47.775420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" event={"ID":"3e133249-145f-4c3b-a1af-8b0e1190f721","Type":"ContainerStarted","Data":"e10e0fa9e7841f22e8b90ca615a14165d698ebe004b0a39e05f2cdaee19dadd5"} Jun 03 19:35:47.775834 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:47.775707 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:35:47.777236 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:47.777214 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855576fd58-hvrcl" Jun 03 19:35:47.782233 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:47.782217 2557 scope.go:117] "RemoveContainer" containerID="a19e554a63dc38642f5042ffb839922a6bdd74ee58841abd8e295b55fca59a03" Jun 03 19:35:48.780796 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:48.780759 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fdc6cbdd-sj7md" event={"ID":"27adec03-f551-4935-8f80-ad9f723c1a9f","Type":"ContainerStarted","Data":"de7f7c37908f357386c42b2f5bb84f89a114a8f5f92b3d5f7abded2fa1deaef2"} Jun 03 19:35:53.777238 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:53.777202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:35:57.810935 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:57.810851 2557 generic.go:356] "Generic (PLEG): container finished" podID="6825f252-192e-4d9f-9c81-37397afe36fe" containerID="a5ba64004d5e73d030e30b23914bab447c534a7079a7b9e5b6b1673b5850e0bf" exitCode=0 Jun 03 19:35:57.811275 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:57.810929 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" event={"ID":"6825f252-192e-4d9f-9c81-37397afe36fe","Type":"ContainerDied","Data":"a5ba64004d5e73d030e30b23914bab447c534a7079a7b9e5b6b1673b5850e0bf"} Jun 03 19:35:57.811275 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:57.811249 2557 scope.go:117] "RemoveContainer" containerID="a5ba64004d5e73d030e30b23914bab447c534a7079a7b9e5b6b1673b5850e0bf" Jun 03 19:35:58.816181 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:35:58.816144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-9dpfk" event={"ID":"6825f252-192e-4d9f-9c81-37397afe36fe","Type":"ContainerStarted","Data":"d279f0c0417d87b80b40b9cb48c48c17198b9e6f4d61260367ea96bed5ecb4d8"} Jun 03 19:37:00.647760 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.647725 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:37:00.650005 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.649984 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dbf39bc-d077-40f8-83c9-42e0b08dc9fd-metrics-certs\") pod \"network-metrics-daemon-z5vhs\" (UID: \"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd\") " pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:37:00.680007 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.679982 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\"" Jun 03 19:37:00.688967 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.688947 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5vhs" Jun 03 19:37:00.817353 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.817322 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5vhs"] Jun 03 19:37:00.819795 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:37:00.819763 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbf39bc_d077_40f8_83c9_42e0b08dc9fd.slice/crio-242d69f5327a7b5d5bc6ebb3ba595f976787acb0db07152e0e63559c57f1af4b WatchSource:0}: Error finding container 242d69f5327a7b5d5bc6ebb3ba595f976787acb0db07152e0e63559c57f1af4b: Status 404 returned error can't find the container with id 242d69f5327a7b5d5bc6ebb3ba595f976787acb0db07152e0e63559c57f1af4b Jun 03 19:37:00.821678 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:00.821663 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:37:01.020173 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:01.020086 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5vhs" event={"ID":"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd","Type":"ContainerStarted","Data":"242d69f5327a7b5d5bc6ebb3ba595f976787acb0db07152e0e63559c57f1af4b"} Jun 03 19:37:02.025686 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:02.025597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5vhs" event={"ID":"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd","Type":"ContainerStarted","Data":"d81f0d45b71c31d6a6a124c8dd474dce602ac7216b4f613176d8340c306224ea"} Jun 03 19:37:02.025686 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:02.025655 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5vhs" event={"ID":"1dbf39bc-d077-40f8-83c9-42e0b08dc9fd","Type":"ContainerStarted","Data":"21b1015bfd0b067a55cc11e696cc348eabfdd38cb93ebf20d617335efaaeaeea"} Jun 03 19:37:02.041306 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:37:02.041248 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z5vhs" podStartSLOduration=375.266247176 podStartE2EDuration="6m16.041235096s" totalImagesPullingTime="774.98792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:02.040260793 +0000 UTC m=+375.725712221" watchObservedRunningTime="2026-06-03 19:37:02.041235096 +0000 UTC m=+375.726686512" Jun 03 19:39:50.348531 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.348438 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2"] Jun 03 19:39:50.351287 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.351270 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.353664 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.353646 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:39:50.354472 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.354454 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:39:50.354580 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.354456 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-47569\"" Jun 03 19:39:50.362236 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.362214 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2"] Jun 03 19:39:50.453130 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.453098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s78v\" (UniqueName: \"kubernetes.io/projected/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-kube-api-access-9s78v\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.453291 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.453140 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.554410 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.554369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s78v\" (UniqueName: \"kubernetes.io/projected/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-kube-api-access-9s78v\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.554549 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.554426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.554773 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.554754 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.562158 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.562137 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s78v\" (UniqueName: \"kubernetes.io/projected/1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05-kube-api-access-9s78v\") pod \"openshift-lws-operator-fd8ccff4c-kqlt2\" (UID: \"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.663280 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.663197 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" Jun 03 19:39:50.784660 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:50.784492 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2"] Jun 03 19:39:50.787337 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:39:50.787313 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a7d0850_4fbc_4dc0_bb8d_a483d41c3e05.slice/crio-624dcf22bab1b5886c90d71aadb616d0bf254ef54265e1fa0014af84836a5a06 WatchSource:0}: Error finding container 624dcf22bab1b5886c90d71aadb616d0bf254ef54265e1fa0014af84836a5a06: Status 404 returned error can't find the container with id 624dcf22bab1b5886c90d71aadb616d0bf254ef54265e1fa0014af84836a5a06 Jun 03 19:39:51.615947 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:51.615914 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" event={"ID":"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05","Type":"ContainerStarted","Data":"624dcf22bab1b5886c90d71aadb616d0bf254ef54265e1fa0014af84836a5a06"} Jun 03 19:39:52.578907 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.578871 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-dqj9j"] Jun 03 19:39:52.582139 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.582115 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.584384 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.584360 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 19:39:52.584531 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.584405 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 19:39:52.585134 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.585115 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sspwn\"" Jun 03 19:39:52.591130 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.591078 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-dqj9j"] Jun 03 19:39:52.770440 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.770402 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-bound-sa-token\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.770888 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.770460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzh4d\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-kube-api-access-fzh4d\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.870882 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.870854 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-bound-sa-token\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.870996 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.870908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzh4d\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-kube-api-access-fzh4d\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.880360 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.880338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-bound-sa-token\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.880489 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.880453 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzh4d\" (UniqueName: \"kubernetes.io/projected/586be424-5fbe-4d38-8a93-474c849d2036-kube-api-access-fzh4d\") pod \"cert-manager-59c77684cc-dqj9j\" (UID: \"586be424-5fbe-4d38-8a93-474c849d2036\") " pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:52.895374 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:52.895344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-dqj9j" Jun 03 19:39:53.905358 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:53.905331 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-dqj9j"] Jun 03 19:39:53.908720 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:39:53.908695 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod586be424_5fbe_4d38_8a93_474c849d2036.slice/crio-9eb9956e81123756bf1da8e4e09f506c74cab7f41f75d4c8c03a75109f48f476 WatchSource:0}: Error finding container 9eb9956e81123756bf1da8e4e09f506c74cab7f41f75d4c8c03a75109f48f476: Status 404 returned error can't find the container with id 9eb9956e81123756bf1da8e4e09f506c74cab7f41f75d4c8c03a75109f48f476 Jun 03 19:39:54.628708 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:54.628669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-dqj9j" event={"ID":"586be424-5fbe-4d38-8a93-474c849d2036","Type":"ContainerStarted","Data":"9eb9956e81123756bf1da8e4e09f506c74cab7f41f75d4c8c03a75109f48f476"} Jun 03 19:39:54.630237 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:54.630215 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" event={"ID":"1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05","Type":"ContainerStarted","Data":"4a53d2f583f47f4a2408d7cd750e312423dc995224eafa5cd95a3c19ad55c717"} Jun 03 19:39:54.645213 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:54.645171 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kqlt2" podStartSLOduration=1.587253308 podStartE2EDuration="4.645157548s" totalImagesPullingTime="3.05790424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:54.644032186 +0000 UTC m=+548.329483603" watchObservedRunningTime="2026-06-03 19:39:54.645157548 +0000 UTC m=+548.330608968" Jun 03 19:39:57.643833 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:57.643790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-dqj9j" event={"ID":"586be424-5fbe-4d38-8a93-474c849d2036","Type":"ContainerStarted","Data":"94d656aac89a0ad16d63cf889551b514da3c0a0de79473f3b1023772ae5a5d59"} Jun 03 19:39:57.662709 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:39:57.662659 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-dqj9j" podStartSLOduration=2.781545123 podStartE2EDuration="5.662640709s" totalImagesPullingTime="2.881095586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:57.661268166 +0000 UTC m=+551.346719583" watchObservedRunningTime="2026-06-03 19:39:57.662640709 +0000 UTC m=+551.348092125" Jun 03 19:40:10.474083 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.474044 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2"] Jun 03 19:40:10.477356 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.477334 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.480399 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.480378 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:40:10.481174 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.481148 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:40:10.481374 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.481341 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:40:10.481458 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.481383 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tmlx9\"" Jun 03 19:40:10.481458 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.481210 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:40:10.494275 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.494254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.494376 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.494288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.494376 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.494319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcdqg\" (UniqueName: \"kubernetes.io/projected/12ef381d-799d-486a-b65f-4fadc1537f69-kube-api-access-zcdqg\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.494453 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.494380 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.494453 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.494421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.504015 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.503989 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2"] Jun 03 19:40:10.594934 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.594897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.595105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.594948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.595105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.594991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcdqg\" (UniqueName: \"kubernetes.io/projected/12ef381d-799d-486a-b65f-4fadc1537f69-kube-api-access-zcdqg\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.595105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.595033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.595216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.595163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.595528 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.595498 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.597252 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.597233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ef381d-799d-486a-b65f-4fadc1537f69-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.597363 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.597347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.597598 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.597580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12ef381d-799d-486a-b65f-4fadc1537f69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.605756 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.605734 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcdqg\" (UniqueName: \"kubernetes.io/projected/12ef381d-799d-486a-b65f-4fadc1537f69-kube-api-access-zcdqg\") pod \"opendatahub-operator-controller-manager-548746c444-8xjq2\" (UID: \"12ef381d-799d-486a-b65f-4fadc1537f69\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.791410 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.791333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:10.923300 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:10.923258 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2"] Jun 03 19:40:10.927239 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:10.927213 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ef381d_799d_486a_b65f_4fadc1537f69.slice/crio-782d8285a73286e0142853b65161c9f416f0be2da0056bdb24cd0b2df275cafa WatchSource:0}: Error finding container 782d8285a73286e0142853b65161c9f416f0be2da0056bdb24cd0b2df275cafa: Status 404 returned error can't find the container with id 782d8285a73286e0142853b65161c9f416f0be2da0056bdb24cd0b2df275cafa Jun 03 19:40:11.696563 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:11.696524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" event={"ID":"12ef381d-799d-486a-b65f-4fadc1537f69","Type":"ContainerStarted","Data":"782d8285a73286e0142853b65161c9f416f0be2da0056bdb24cd0b2df275cafa"} Jun 03 19:40:14.710021 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:14.709991 2557 generic.go:356] "Generic (PLEG): container finished" podID="12ef381d-799d-486a-b65f-4fadc1537f69" containerID="6134fa4cd63c0b0a6bcab471def708ae8bc43eea273fb26c3350aa02f63b2553" exitCode=0 Jun 03 19:40:14.710331 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:14.710058 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" event={"ID":"12ef381d-799d-486a-b65f-4fadc1537f69","Type":"ContainerDied","Data":"6134fa4cd63c0b0a6bcab471def708ae8bc43eea273fb26c3350aa02f63b2553"} Jun 03 19:40:15.716251 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:15.716212 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" event={"ID":"12ef381d-799d-486a-b65f-4fadc1537f69","Type":"ContainerStarted","Data":"ef9363b85106827cb1be7c58f4e377ac5f1a1bf8c3d15cc5774d6313272e94f5"} Jun 03 19:40:15.716714 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:15.716321 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:15.742009 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:15.741945 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" podStartSLOduration=1.657460309 podStartE2EDuration="5.741927101s" totalImagesPullingTime="3.173831885s" totalInitContainerRuntime="910.634907ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:15.740097985 +0000 UTC m=+569.425549399" watchObservedRunningTime="2026-06-03 19:40:15.741927101 +0000 UTC m=+569.427378517" Jun 03 19:40:26.722445 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:26.722415 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-8xjq2" Jun 03 19:40:29.402684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.402648 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-grzw6"] Jun 03 19:40:29.420111 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.420086 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.423466 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.423433 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:40:29.424209 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.424191 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 19:40:29.424771 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.424754 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:40:29.427633 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.427607 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 19:40:29.439392 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.439367 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-grzw6"] Jun 03 19:40:29.537345 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.537313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93af5aec-a2aa-4cdc-ad1f-720942426a42-tls-certs\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.537345 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.537349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93af5aec-a2aa-4cdc-ad1f-720942426a42-tmp\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.537601 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.537391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l458x\" (UniqueName: \"kubernetes.io/projected/93af5aec-a2aa-4cdc-ad1f-720942426a42-kube-api-access-l458x\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.546054 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.546027 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8fb"] Jun 03 19:40:29.566497 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.566448 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8fb"] Jun 03 19:40:29.566690 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.566592 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.568808 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.568780 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 19:40:29.568936 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.568814 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dll4n\"" Jun 03 19:40:29.638518 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.638490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l458x\" (UniqueName: \"kubernetes.io/projected/93af5aec-a2aa-4cdc-ad1f-720942426a42-kube-api-access-l458x\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.638684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.638525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.638684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.638544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfnh\" (UniqueName: \"kubernetes.io/projected/60196090-f651-41e4-89c8-6de2579144c9-kube-api-access-xxfnh\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.638684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.638582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93af5aec-a2aa-4cdc-ad1f-720942426a42-tls-certs\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.638684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.638601 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93af5aec-a2aa-4cdc-ad1f-720942426a42-tmp\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.640705 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.640675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93af5aec-a2aa-4cdc-ad1f-720942426a42-tmp\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.640924 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.640906 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93af5aec-a2aa-4cdc-ad1f-720942426a42-tls-certs\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.645424 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.645397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l458x\" (UniqueName: \"kubernetes.io/projected/93af5aec-a2aa-4cdc-ad1f-720942426a42-kube-api-access-l458x\") pod \"kube-auth-proxy-89c854d9f-grzw6\" (UID: \"93af5aec-a2aa-4cdc-ad1f-720942426a42\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.729012 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.728930 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" Jun 03 19:40:29.739284 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.739250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.739284 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.739284 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfnh\" (UniqueName: \"kubernetes.io/projected/60196090-f651-41e4-89c8-6de2579144c9-kube-api-access-xxfnh\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.739584 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:29.739411 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 19:40:29.739584 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:29.739521 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert podName:60196090-f651-41e4-89c8-6de2579144c9 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:30.239498572 +0000 UTC m=+583.924949979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert") pod "odh-model-controller-6dc94f689f-wl8fb" (UID: "60196090-f651-41e4-89c8-6de2579144c9") : secret "odh-model-controller-webhook-cert" not found Jun 03 19:40:29.747831 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.747807 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfnh\" (UniqueName: \"kubernetes.io/projected/60196090-f651-41e4-89c8-6de2579144c9-kube-api-access-xxfnh\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:29.881080 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:29.881046 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-grzw6"] Jun 03 19:40:29.884747 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:29.884716 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93af5aec_a2aa_4cdc_ad1f_720942426a42.slice/crio-25536dc0c5816034cab5873e61f18ae2aec469228be891c1e9e1e8d4187d0384 WatchSource:0}: Error finding container 25536dc0c5816034cab5873e61f18ae2aec469228be891c1e9e1e8d4187d0384: Status 404 returned error can't find the container with id 25536dc0c5816034cab5873e61f18ae2aec469228be891c1e9e1e8d4187d0384 Jun 03 19:40:30.152589 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.152551 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-886h7"] Jun 03 19:40:30.177810 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.177779 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-886h7"] Jun 03 19:40:30.177956 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.177919 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.180257 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.180233 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 19:40:30.180381 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.180281 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-klwh7\"" Jun 03 19:40:30.242506 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.242459 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-tls-certs\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.242655 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.242514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p45sl\" (UniqueName: \"kubernetes.io/projected/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-kube-api-access-p45sl\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.242655 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.242591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:30.245137 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.245107 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60196090-f651-41e4-89c8-6de2579144c9-cert\") pod \"odh-model-controller-6dc94f689f-wl8fb\" (UID: \"60196090-f651-41e4-89c8-6de2579144c9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:30.343491 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.343439 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-tls-certs\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.343491 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.343486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p45sl\" (UniqueName: \"kubernetes.io/projected/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-kube-api-access-p45sl\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.346014 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.345987 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-tls-certs\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.351517 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.351493 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p45sl\" (UniqueName: \"kubernetes.io/projected/32e6b80a-8aca-4c7d-83bd-349f9452cfd6-kube-api-access-p45sl\") pod \"model-serving-api-5dd488fc48-886h7\" (UID: \"32e6b80a-8aca-4c7d-83bd-349f9452cfd6\") " pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.480120 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.480036 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:30.488234 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.488206 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:30.651904 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.651805 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8fb"] Jun 03 19:40:30.668499 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:30.668455 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60196090_f651_41e4_89c8_6de2579144c9.slice/crio-576f769cfab6735777749ec4434218c95aa928ae269da03cc932ff98ad560408 WatchSource:0}: Error finding container 576f769cfab6735777749ec4434218c95aa928ae269da03cc932ff98ad560408: Status 404 returned error can't find the container with id 576f769cfab6735777749ec4434218c95aa928ae269da03cc932ff98ad560408 Jun 03 19:40:30.681467 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.680788 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-886h7"] Jun 03 19:40:30.682742 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:30.682708 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e6b80a_8aca_4c7d_83bd_349f9452cfd6.slice/crio-50597afd26d0b9ee48b9a991681efbf1bb7f386a9c6d24ac7796df78033e293b WatchSource:0}: Error finding container 50597afd26d0b9ee48b9a991681efbf1bb7f386a9c6d24ac7796df78033e293b: Status 404 returned error can't find the container with id 50597afd26d0b9ee48b9a991681efbf1bb7f386a9c6d24ac7796df78033e293b Jun 03 19:40:30.786106 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.785937 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-886h7" event={"ID":"32e6b80a-8aca-4c7d-83bd-349f9452cfd6","Type":"ContainerStarted","Data":"50597afd26d0b9ee48b9a991681efbf1bb7f386a9c6d24ac7796df78033e293b"} Jun 03 19:40:30.786106 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.785998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" event={"ID":"60196090-f651-41e4-89c8-6de2579144c9","Type":"ContainerStarted","Data":"576f769cfab6735777749ec4434218c95aa928ae269da03cc932ff98ad560408"} Jun 03 19:40:30.786106 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:30.786025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" event={"ID":"93af5aec-a2aa-4cdc-ad1f-720942426a42","Type":"ContainerStarted","Data":"25536dc0c5816034cab5873e61f18ae2aec469228be891c1e9e1e8d4187d0384"} Jun 03 19:40:35.814013 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.813974 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-886h7" event={"ID":"32e6b80a-8aca-4c7d-83bd-349f9452cfd6","Type":"ContainerStarted","Data":"114775fd8e85d8e25b3f73c0c3b4ec3aab826f22887980f2c3c8c168f6dbec67"} Jun 03 19:40:35.814503 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.814083 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:35.815764 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.815736 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" event={"ID":"60196090-f651-41e4-89c8-6de2579144c9","Type":"ContainerStarted","Data":"2c84eafed4dd1bce90901cc53dbbf39ccd95d4a1990cb046098fa0fc2198ab8b"} Jun 03 19:40:35.815874 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.815819 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:35.817200 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.817176 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" event={"ID":"93af5aec-a2aa-4cdc-ad1f-720942426a42","Type":"ContainerStarted","Data":"ce63f8b120e54d9caa58275459a0a9a286698406b3ca7465f63e4f22e5a9dc99"} Jun 03 19:40:35.829960 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.829915 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-886h7" podStartSLOduration=1.644123457 podStartE2EDuration="5.829899505s" totalImagesPullingTime="4.185776048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:35.82942157 +0000 UTC m=+589.514872987" watchObservedRunningTime="2026-06-03 19:40:35.829899505 +0000 UTC m=+589.515350901" Jun 03 19:40:35.845657 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.845618 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-89c854d9f-grzw6" podStartSLOduration=1.869877126 podStartE2EDuration="6.845606236s" totalImagesPullingTime="4.97572911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:35.84424418 +0000 UTC m=+589.529695596" watchObservedRunningTime="2026-06-03 19:40:35.845606236 +0000 UTC m=+589.531057657" Jun 03 19:40:35.858544 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:35.858472 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" podStartSLOduration=2.659652478 podStartE2EDuration="6.858442737s" totalImagesPullingTime="4.198790259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:35.857933337 +0000 UTC m=+589.543384777" watchObservedRunningTime="2026-06-03 19:40:35.858442737 +0000 UTC m=+589.543894150" Jun 03 19:40:40.129425 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.129390 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ldwvc"] Jun 03 19:40:40.131914 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.131897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.134175 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.134154 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 19:40:40.134316 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.134276 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7gtfp\"" Jun 03 19:40:40.138536 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.138513 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54"] Jun 03 19:40:40.140823 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.140803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.141671 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.141650 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ldwvc"] Jun 03 19:40:40.143038 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.143022 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 19:40:40.143150 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.143063 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qpm6r\"" Jun 03 19:40:40.152948 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.152926 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54"] Jun 03 19:40:40.235568 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.235533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lk9b\" (UniqueName: \"kubernetes.io/projected/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-kube-api-access-7lk9b\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.235568 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.235568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s758\" (UniqueName: \"kubernetes.io/projected/221381f3-c399-44fe-8209-9e050f8d44a9-kube-api-access-7s758\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.235765 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.235586 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.235765 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.235604 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.336876 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.336838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.337049 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.336951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lk9b\" (UniqueName: \"kubernetes.io/projected/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-kube-api-access-7lk9b\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.337049 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.336983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s758\" (UniqueName: \"kubernetes.io/projected/221381f3-c399-44fe-8209-9e050f8d44a9-kube-api-access-7s758\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.337049 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.337002 2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 03 19:40:40.337049 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.337006 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.337230 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.337079 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert podName:ec30bd03-eb9b-4b3f-95d5-460cc99e5a71 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:40.837056172 +0000 UTC m=+594.522507570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert") pod "llmisvc-controller-manager-864bfd7bc9-lmg54" (UID: "ec30bd03-eb9b-4b3f-95d5-460cc99e5a71") : secret "llmisvc-webhook-server-cert" not found Jun 03 19:40:40.337230 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.337098 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 19:40:40.337230 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.337139 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert podName:221381f3-c399-44fe-8209-9e050f8d44a9 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:40.837127961 +0000 UTC m=+594.522579361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert") pod "kserve-controller-manager-69fc866d76-ldwvc" (UID: "221381f3-c399-44fe-8209-9e050f8d44a9") : secret "kserve-webhook-server-cert" not found Jun 03 19:40:40.363848 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.363816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s758\" (UniqueName: \"kubernetes.io/projected/221381f3-c399-44fe-8209-9e050f8d44a9-kube-api-access-7s758\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.363955 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.363848 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lk9b\" (UniqueName: \"kubernetes.io/projected/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-kube-api-access-7lk9b\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.840338 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.840303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:40.840338 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.840338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:40.840580 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.840433 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 19:40:40.840580 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:40:40.840534 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert podName:221381f3-c399-44fe-8209-9e050f8d44a9 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:41.840518582 +0000 UTC m=+595.525969975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert") pod "kserve-controller-manager-69fc866d76-ldwvc" (UID: "221381f3-c399-44fe-8209-9e050f8d44a9") : secret "kserve-webhook-server-cert" not found Jun 03 19:40:40.842631 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:40.842614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec30bd03-eb9b-4b3f-95d5-460cc99e5a71-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lmg54\" (UID: \"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:41.052383 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.052340 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:41.181281 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.181250 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54"] Jun 03 19:40:41.184551 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:41.184521 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podec30bd03_eb9b_4b3f_95d5_460cc99e5a71.slice/crio-271b2db6507e8b89318955438d36e1fcdfa3a3b976a2f7f2802f2a40edd40559 WatchSource:0}: Error finding container 271b2db6507e8b89318955438d36e1fcdfa3a3b976a2f7f2802f2a40edd40559: Status 404 returned error can't find the container with id 271b2db6507e8b89318955438d36e1fcdfa3a3b976a2f7f2802f2a40edd40559 Jun 03 19:40:41.844338 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.844299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" event={"ID":"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71","Type":"ContainerStarted","Data":"271b2db6507e8b89318955438d36e1fcdfa3a3b976a2f7f2802f2a40edd40559"} Jun 03 19:40:41.847898 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.847869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:41.850691 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.850666 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221381f3-c399-44fe-8209-9e050f8d44a9-cert\") pod \"kserve-controller-manager-69fc866d76-ldwvc\" (UID: \"221381f3-c399-44fe-8209-9e050f8d44a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:41.943783 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:41.943748 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:42.326787 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:42.326715 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ldwvc"] Jun 03 19:40:42.333797 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:42.333755 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221381f3_c399_44fe_8209_9e050f8d44a9.slice/crio-a5947d3fb9f04eb74eedec0c80f8114b2857b3ecef5b1e6ca9cbc8ce133a5ee1 WatchSource:0}: Error finding container a5947d3fb9f04eb74eedec0c80f8114b2857b3ecef5b1e6ca9cbc8ce133a5ee1: Status 404 returned error can't find the container with id a5947d3fb9f04eb74eedec0c80f8114b2857b3ecef5b1e6ca9cbc8ce133a5ee1 Jun 03 19:40:42.851143 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:42.851105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" event={"ID":"221381f3-c399-44fe-8209-9e050f8d44a9","Type":"ContainerStarted","Data":"a5947d3fb9f04eb74eedec0c80f8114b2857b3ecef5b1e6ca9cbc8ce133a5ee1"} Jun 03 19:40:44.861730 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:44.861680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" event={"ID":"ec30bd03-eb9b-4b3f-95d5-460cc99e5a71","Type":"ContainerStarted","Data":"5e3d40ef9752262c00b9bed1564e83a4fd1522679a76ef293dc8ff6435054515"} Jun 03 19:40:44.862141 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:44.861831 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:40:45.868786 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:45.868752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" event={"ID":"221381f3-c399-44fe-8209-9e050f8d44a9","Type":"ContainerStarted","Data":"cbf912983ebbb25a4f3ef03bc9fec00d097e9b67d58e3909ba4725a3a6255a18"} Jun 03 19:40:45.888470 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:45.888419 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" podStartSLOduration=3.073426408 podStartE2EDuration="5.88840423s" totalImagesPullingTime="2.814977822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:45.88770311 +0000 UTC m=+599.573154526" watchObservedRunningTime="2026-06-03 19:40:45.88840423 +0000 UTC m=+599.573855644" Jun 03 19:40:45.888861 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:45.888836 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" podStartSLOduration=2.7908753060000002 podStartE2EDuration="5.888828502s" totalImagesPullingTime="3.097953196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:44.92835968 +0000 UTC m=+598.613811094" watchObservedRunningTime="2026-06-03 19:40:45.888828502 +0000 UTC m=+599.574279916" Jun 03 19:40:46.753960 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.753936 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:40:46.755337 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.755311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:40:46.762246 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.762225 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:40:46.763587 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.763568 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:40:46.825578 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.825499 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-886h7" Jun 03 19:40:46.846976 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.840910 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-wl8fb" Jun 03 19:40:46.874283 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:46.874245 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:40:48.269752 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.269716 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p"] Jun 03 19:40:48.272679 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.272661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.275426 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.275404 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 19:40:48.275872 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.275855 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-wn4bc\"" Jun 03 19:40:48.275920 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.275897 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 19:40:48.291459 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.291438 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p"] Jun 03 19:40:48.405157 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.405131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqp7x\" (UniqueName: \"kubernetes.io/projected/47b380cb-6b6e-434d-8b48-062b3e6e2926-kube-api-access-xqp7x\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.405294 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.405189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b380cb-6b6e-434d-8b48-062b3e6e2926-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.505646 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.505614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b380cb-6b6e-434d-8b48-062b3e6e2926-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.505800 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.505666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp7x\" (UniqueName: \"kubernetes.io/projected/47b380cb-6b6e-434d-8b48-062b3e6e2926-kube-api-access-xqp7x\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.507925 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.507902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b380cb-6b6e-434d-8b48-062b3e6e2926-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.515020 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.514995 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqp7x\" (UniqueName: \"kubernetes.io/projected/47b380cb-6b6e-434d-8b48-062b3e6e2926-kube-api-access-xqp7x\") pod \"servicemesh-operator3-57f65f65fb-fwz4p\" (UID: \"47b380cb-6b6e-434d-8b48-062b3e6e2926\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.581733 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.581661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:48.710587 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.710564 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p"] Jun 03 19:40:48.713060 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:40:48.713032 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b380cb_6b6e_434d_8b48_062b3e6e2926.slice/crio-bdff722c18a23edf64825536db794394c015095648d904b8de3036bf9ecef734 WatchSource:0}: Error finding container bdff722c18a23edf64825536db794394c015095648d904b8de3036bf9ecef734: Status 404 returned error can't find the container with id bdff722c18a23edf64825536db794394c015095648d904b8de3036bf9ecef734 Jun 03 19:40:48.883943 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:48.883907 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" event={"ID":"47b380cb-6b6e-434d-8b48-062b3e6e2926","Type":"ContainerStarted","Data":"bdff722c18a23edf64825536db794394c015095648d904b8de3036bf9ecef734"} Jun 03 19:40:51.900258 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:51.900223 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" event={"ID":"47b380cb-6b6e-434d-8b48-062b3e6e2926","Type":"ContainerStarted","Data":"2745230ce5b7799c147ce173aba0e2f18f11d5de6f54f8301581cd3aa105d9c9"} Jun 03 19:40:51.900674 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:51.900460 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:40:51.920550 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:51.920495 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" podStartSLOduration=0.825636708 podStartE2EDuration="3.920460457s" totalImagesPullingTime="3.094823749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:51.918562275 +0000 UTC m=+605.604013690" watchObservedRunningTime="2026-06-03 19:40:51.920460457 +0000 UTC m=+605.605911871" Jun 03 19:40:59.692744 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.692667 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-6qd6c"] Jun 03 19:40:59.695429 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.695405 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.697539 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.697516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3268f59c-2e0b-446b-b1e1-77fbabd111e5-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.697643 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.697559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7t9\" (UniqueName: \"kubernetes.io/projected/3268f59c-2e0b-446b-b1e1-77fbabd111e5-kube-api-access-qb7t9\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.697949 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.697932 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:40:59.698059 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.698041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d7qfw\"" Jun 03 19:40:59.702872 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.702671 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-6qd6c"] Jun 03 19:40:59.798384 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.798353 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3268f59c-2e0b-446b-b1e1-77fbabd111e5-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.798553 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.798408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7t9\" (UniqueName: \"kubernetes.io/projected/3268f59c-2e0b-446b-b1e1-77fbabd111e5-kube-api-access-qb7t9\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.799055 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.799036 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3268f59c-2e0b-446b-b1e1-77fbabd111e5-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:40:59.806351 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:40:59.806331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7t9\" (UniqueName: \"kubernetes.io/projected/3268f59c-2e0b-446b-b1e1-77fbabd111e5-kube-api-access-qb7t9\") pod \"dashboard-redirect-fbff5bcdc-6qd6c\" (UID: \"3268f59c-2e0b-446b-b1e1-77fbabd111e5\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:41:00.007408 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:00.007323 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" Jun 03 19:41:00.127359 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:00.127337 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-6qd6c"] Jun 03 19:41:00.130044 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:41:00.130013 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3268f59c_2e0b_446b_b1e1_77fbabd111e5.slice/crio-0bec59d22fa9305a182a83ed3d17310f3fcfdfcf5b82dbab2f047105096ce42d WatchSource:0}: Error finding container 0bec59d22fa9305a182a83ed3d17310f3fcfdfcf5b82dbab2f047105096ce42d: Status 404 returned error can't find the container with id 0bec59d22fa9305a182a83ed3d17310f3fcfdfcf5b82dbab2f047105096ce42d Jun 03 19:41:00.941030 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:00.940989 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" event={"ID":"3268f59c-2e0b-446b-b1e1-77fbabd111e5","Type":"ContainerStarted","Data":"0bec59d22fa9305a182a83ed3d17310f3fcfdfcf5b82dbab2f047105096ce42d"} Jun 03 19:41:02.907613 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:02.907585 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fwz4p" Jun 03 19:41:06.975946 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:06.975909 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" event={"ID":"3268f59c-2e0b-446b-b1e1-77fbabd111e5","Type":"ContainerStarted","Data":"082ea6d0d790c0247a57d4363265a255e935032cdc154f80671c2fb370eec652"} Jun 03 19:41:06.999245 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:06.999204 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-fbff5bcdc-6qd6c" podStartSLOduration=1.954461848 podStartE2EDuration="7.999191736s" totalImagesPullingTime="6.044729888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:06.997959981 +0000 UTC m=+620.683411394" watchObservedRunningTime="2026-06-03 19:41:06.999191736 +0000 UTC m=+620.684643150" Jun 03 19:41:14.386574 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.386542 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh"] Jun 03 19:41:14.392373 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.392353 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.394736 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.394709 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:41:14.394736 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.394724 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 19:41:14.395003 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.394725 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 19:41:14.395003 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.394978 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 19:41:14.395086 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.395055 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-flmm6\"" Jun 03 19:41:14.402073 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.402052 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh"] Jun 03 19:41:14.414202 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414322 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414322 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r8cf\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-kube-api-access-9r8cf\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414423 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414423 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc815c63-519a-4fa3-8e65-e869ac699eac-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414423 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.414423 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.414419 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515008 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.514978 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515008 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515011 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc815c63-519a-4fa3-8e65-e869ac699eac-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r8cf\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-kube-api-access-9r8cf\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.515834 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.515811 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.517400 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.517373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.517505 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.517400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.517505 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.517401 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc815c63-519a-4fa3-8e65-e869ac699eac-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.517505 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.517455 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.523248 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.523218 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.523541 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.523525 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r8cf\" (UniqueName: \"kubernetes.io/projected/bc815c63-519a-4fa3-8e65-e869ac699eac-kube-api-access-9r8cf\") pod \"istiod-openshift-gateway-75c67f8887-cnpdh\" (UID: \"bc815c63-519a-4fa3-8e65-e869ac699eac\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.703021 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.702944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:14.838616 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:14.838583 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh"] Jun 03 19:41:14.841941 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:41:14.841914 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc815c63_519a_4fa3_8e65_e869ac699eac.slice/crio-7e738533770d6d6d19ea3dd8494632479421c95ba1ba378df23a8023b51bad65 WatchSource:0}: Error finding container 7e738533770d6d6d19ea3dd8494632479421c95ba1ba378df23a8023b51bad65: Status 404 returned error can't find the container with id 7e738533770d6d6d19ea3dd8494632479421c95ba1ba378df23a8023b51bad65 Jun 03 19:41:15.012418 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:15.012326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" event={"ID":"bc815c63-519a-4fa3-8e65-e869ac699eac","Type":"ContainerStarted","Data":"7e738533770d6d6d19ea3dd8494632479421c95ba1ba378df23a8023b51bad65"} Jun 03 19:41:15.871437 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:15.871405 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lmg54" Jun 03 19:41:17.883919 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:17.883888 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ldwvc" Jun 03 19:41:18.825711 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:18.825672 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:41:18.825786 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:18.825760 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:41:19.034558 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:19.034521 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" event={"ID":"bc815c63-519a-4fa3-8e65-e869ac699eac","Type":"ContainerStarted","Data":"fd62fb567e8dd1cca80abc8956a71cb6013e5d1df39c4606b432ed429a6c7980"} Jun 03 19:41:19.034997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:19.034788 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:41:19.036455 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:19.036426 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-cnpdh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 19:41:19.036597 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:19.036494 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" podUID="bc815c63-519a-4fa3-8e65-e869ac699eac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:41:19.055946 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:19.055902 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" podStartSLOduration=1.07478662 podStartE2EDuration="5.055887853s" totalImagesPullingTime="3.981101233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:19.0537413 +0000 UTC m=+632.739192728" watchObservedRunningTime="2026-06-03 19:41:19.055887853 +0000 UTC m=+632.741339268" Jun 03 19:41:20.040567 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:41:20.040538 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cnpdh" Jun 03 19:42:13.037972 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.037937 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-64pqg"] Jun 03 19:42:13.040469 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.040451 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:13.042777 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.042754 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:42:13.042894 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.042762 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:42:13.043507 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.043491 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nr6x4\"" Jun 03 19:42:13.049974 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.049950 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-64pqg"] Jun 03 19:42:13.108734 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.108699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkmdj\" (UniqueName: \"kubernetes.io/projected/3cc43ca9-16ba-4995-839c-655355ece21f-kube-api-access-vkmdj\") pod \"authorino-operator-75cc8d5cb7-64pqg\" (UID: \"3cc43ca9-16ba-4995-839c-655355ece21f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:13.209757 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.209712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkmdj\" (UniqueName: \"kubernetes.io/projected/3cc43ca9-16ba-4995-839c-655355ece21f-kube-api-access-vkmdj\") pod \"authorino-operator-75cc8d5cb7-64pqg\" (UID: \"3cc43ca9-16ba-4995-839c-655355ece21f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:13.217727 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.217695 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkmdj\" (UniqueName: \"kubernetes.io/projected/3cc43ca9-16ba-4995-839c-655355ece21f-kube-api-access-vkmdj\") pod \"authorino-operator-75cc8d5cb7-64pqg\" (UID: \"3cc43ca9-16ba-4995-839c-655355ece21f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:13.352066 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.352038 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:13.484159 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.483995 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-64pqg"] Jun 03 19:42:13.486977 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:42:13.486950 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc43ca9_16ba_4995_839c_655355ece21f.slice/crio-fddcb792bc11cb1fdc478c9f2009afa9daaad98bc20cd30b4614085fde700030 WatchSource:0}: Error finding container fddcb792bc11cb1fdc478c9f2009afa9daaad98bc20cd30b4614085fde700030: Status 404 returned error can't find the container with id fddcb792bc11cb1fdc478c9f2009afa9daaad98bc20cd30b4614085fde700030 Jun 03 19:42:13.489003 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:13.488987 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:42:14.310537 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:14.310500 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" event={"ID":"3cc43ca9-16ba-4995-839c-655355ece21f","Type":"ContainerStarted","Data":"fddcb792bc11cb1fdc478c9f2009afa9daaad98bc20cd30b4614085fde700030"} Jun 03 19:42:16.325207 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:16.325003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" event={"ID":"3cc43ca9-16ba-4995-839c-655355ece21f","Type":"ContainerStarted","Data":"e03b195c9c1ee58c03082ba577bdf36715cec02cbedd0470fa039102a92997eb"} Jun 03 19:42:16.325207 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:16.325095 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:16.343368 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:16.343321 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" podStartSLOduration=1.266337584 podStartE2EDuration="3.34330576s" totalImagesPullingTime="2.076968176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:16.342285899 +0000 UTC m=+690.027737315" watchObservedRunningTime="2026-06-03 19:42:16.34330576 +0000 UTC m=+690.028757176" Jun 03 19:42:17.096613 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.096565 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7"] Jun 03 19:42:17.099384 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.099360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:17.102787 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.102761 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j44nm\"" Jun 03 19:42:17.102924 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.102799 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 19:42:17.119077 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.119031 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7"] Jun 03 19:42:17.145661 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.145624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrzx\" (UniqueName: \"kubernetes.io/projected/5735f6f5-1f45-4e50-8b90-91d37125be6d-kube-api-access-nrrzx\") pod \"dns-operator-controller-manager-864dd78c4c-c79s7\" (UID: \"5735f6f5-1f45-4e50-8b90-91d37125be6d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:17.246364 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.246332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrzx\" (UniqueName: \"kubernetes.io/projected/5735f6f5-1f45-4e50-8b90-91d37125be6d-kube-api-access-nrrzx\") pod \"dns-operator-controller-manager-864dd78c4c-c79s7\" (UID: \"5735f6f5-1f45-4e50-8b90-91d37125be6d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:17.266820 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.266782 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrzx\" (UniqueName: \"kubernetes.io/projected/5735f6f5-1f45-4e50-8b90-91d37125be6d-kube-api-access-nrrzx\") pod \"dns-operator-controller-manager-864dd78c4c-c79s7\" (UID: \"5735f6f5-1f45-4e50-8b90-91d37125be6d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:17.410310 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.410216 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:17.542994 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:17.542967 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7"] Jun 03 19:42:17.545459 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:42:17.545431 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5735f6f5_1f45_4e50_8b90_91d37125be6d.slice/crio-f902c27f75bced3e742b044744dbb6088c69899a58424bd4de41ccd82c7072d7 WatchSource:0}: Error finding container f902c27f75bced3e742b044744dbb6088c69899a58424bd4de41ccd82c7072d7: Status 404 returned error can't find the container with id f902c27f75bced3e742b044744dbb6088c69899a58424bd4de41ccd82c7072d7 Jun 03 19:42:18.336378 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:18.336341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" event={"ID":"5735f6f5-1f45-4e50-8b90-91d37125be6d","Type":"ContainerStarted","Data":"f902c27f75bced3e742b044744dbb6088c69899a58424bd4de41ccd82c7072d7"} Jun 03 19:42:20.348286 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:20.348250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" event={"ID":"5735f6f5-1f45-4e50-8b90-91d37125be6d","Type":"ContainerStarted","Data":"78c359605db2eadeb6264ce2c2900fa1ef38da5381d4828b54addccb29cb8a6c"} Jun 03 19:42:20.348801 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:20.348355 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:20.364753 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:20.364700 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" podStartSLOduration=1.199526085 podStartE2EDuration="3.364683807s" totalImagesPullingTime="2.165157722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:20.363552865 +0000 UTC m=+694.049004278" watchObservedRunningTime="2026-06-03 19:42:20.364683807 +0000 UTC m=+694.050135223" Jun 03 19:42:27.333212 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.333127 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-64pqg" Jun 03 19:42:27.604873 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.604833 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 19:42:27.608716 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.608692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.613772 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.613747 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjhn\"" Jun 03 19:42:27.629076 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.629046 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 19:42:27.737602 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.737567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.737777 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.737664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.838850 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.838812 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.839022 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.838886 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.839278 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.839259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.850895 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.850870 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh\") pod \"kuadrant-operator-controller-manager-86878c769f-4lqsb\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:27.919551 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:27.919456 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:28.070346 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:28.070319 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 19:42:28.072946 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:42:28.072910 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd66d22d_41e3_4ee8_9516_50dbd12d2af0.slice/crio-5c09782410238854832af2a348b80a20f7ae07f910d1e0732cd8bd651e06c9a2 WatchSource:0}: Error finding container 5c09782410238854832af2a348b80a20f7ae07f910d1e0732cd8bd651e06c9a2: Status 404 returned error can't find the container with id 5c09782410238854832af2a348b80a20f7ae07f910d1e0732cd8bd651e06c9a2 Jun 03 19:42:28.388669 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:28.388635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" event={"ID":"dd66d22d-41e3-4ee8-9516-50dbd12d2af0","Type":"ContainerStarted","Data":"5c09782410238854832af2a348b80a20f7ae07f910d1e0732cd8bd651e06c9a2"} Jun 03 19:42:31.356347 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:31.356310 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c79s7" Jun 03 19:42:33.419205 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:33.419165 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" event={"ID":"dd66d22d-41e3-4ee8-9516-50dbd12d2af0","Type":"ContainerStarted","Data":"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44"} Jun 03 19:42:33.419876 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:33.419338 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:42:33.448356 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:33.448288 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" podStartSLOduration=2.018422077 podStartE2EDuration="6.448264971s" totalImagesPullingTime="4.429842894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:33.445850968 +0000 UTC m=+707.131302385" watchObservedRunningTime="2026-06-03 19:42:33.448264971 +0000 UTC m=+707.133716388" Jun 03 19:42:44.427089 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:42:44.427060 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 19:44:37.800406 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.800366 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:44:37.803210 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.803187 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:37.805754 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.805735 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bcblb\"" Jun 03 19:44:37.806046 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.806030 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:44:37.813797 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.813775 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:44:37.946592 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:37.946558 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49hj\" (UniqueName: \"kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj\") pod \"maas-controller-584786f555-5px22\" (UID: \"c4339a07-625e-4922-af4b-d47a2840252d\") " pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:38.047255 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:38.047223 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49hj\" (UniqueName: \"kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj\") pod \"maas-controller-584786f555-5px22\" (UID: \"c4339a07-625e-4922-af4b-d47a2840252d\") " pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:38.055333 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:38.055280 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49hj\" (UniqueName: \"kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj\") pod \"maas-controller-584786f555-5px22\" (UID: \"c4339a07-625e-4922-af4b-d47a2840252d\") " pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:38.113855 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:38.113822 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:38.241896 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:38.241855 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:44:38.244330 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:44:38.244301 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4339a07_625e_4922_af4b_d47a2840252d.slice/crio-6e9f601a0c5690bd3f7f872febf6e2a6c51c7fadb3ed45e049e54dd2084a2d92 WatchSource:0}: Error finding container 6e9f601a0c5690bd3f7f872febf6e2a6c51c7fadb3ed45e049e54dd2084a2d92: Status 404 returned error can't find the container with id 6e9f601a0c5690bd3f7f872febf6e2a6c51c7fadb3ed45e049e54dd2084a2d92 Jun 03 19:44:39.011986 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:39.011949 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-5px22" event={"ID":"c4339a07-625e-4922-af4b-d47a2840252d","Type":"ContainerStarted","Data":"6e9f601a0c5690bd3f7f872febf6e2a6c51c7fadb3ed45e049e54dd2084a2d92"} Jun 03 19:44:41.023965 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:41.023924 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-5px22" event={"ID":"c4339a07-625e-4922-af4b-d47a2840252d","Type":"ContainerStarted","Data":"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54"} Jun 03 19:44:41.024346 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:41.024056 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:44:41.041685 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:41.041638 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-584786f555-5px22" podStartSLOduration=1.7139528099999999 podStartE2EDuration="4.041625196s" totalImagesPullingTime="2.327672386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:41.040372104 +0000 UTC m=+834.725823521" watchObservedRunningTime="2026-06-03 19:44:41.041625196 +0000 UTC m=+834.727076611" Jun 03 19:44:52.033381 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:44:52.033350 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:45:10.741553 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.741521 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-ff7765497-7kvzk"] Jun 03 19:45:10.744235 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.744218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:10.746557 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.746538 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 19:45:10.757866 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.757846 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-ff7765497-7kvzk"] Jun 03 19:45:10.837196 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.837170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:10.837347 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.837222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5krw\" (UniqueName: \"kubernetes.io/projected/bdd96de1-c3ba-4e46-83aa-90073100347b-kube-api-access-k5krw\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:10.938117 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.938083 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:10.938302 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.938136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5krw\" (UniqueName: \"kubernetes.io/projected/bdd96de1-c3ba-4e46-83aa-90073100347b-kube-api-access-k5krw\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:10.938302 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:45:10.938252 2557 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 03 19:45:10.938429 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:45:10.938335 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls podName:bdd96de1-c3ba-4e46-83aa-90073100347b nodeName:}" failed. No retries permitted until 2026-06-03 19:45:11.4383134 +0000 UTC m=+865.123764807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls") pod "maas-api-ff7765497-7kvzk" (UID: "bdd96de1-c3ba-4e46-83aa-90073100347b") : secret "maas-api-serving-cert" not found Jun 03 19:45:10.946690 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:10.946662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5krw\" (UniqueName: \"kubernetes.io/projected/bdd96de1-c3ba-4e46-83aa-90073100347b-kube-api-access-k5krw\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:11.164608 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.164575 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gv4b6"] Jun 03 19:45:11.167045 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.167030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:11.169339 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.169315 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 19:45:11.169453 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.169394 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-86njf\"" Jun 03 19:45:11.177270 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.177248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gv4b6"] Jun 03 19:45:11.241079 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.241052 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gs4\" (UniqueName: \"kubernetes.io/projected/8f71f768-a487-484f-81cf-26dc8bbd9134-kube-api-access-t9gs4\") pod \"payload-processing-7c6c859784-gv4b6\" (UID: \"8f71f768-a487-484f-81cf-26dc8bbd9134\") " pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:11.341933 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.341900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gs4\" (UniqueName: \"kubernetes.io/projected/8f71f768-a487-484f-81cf-26dc8bbd9134-kube-api-access-t9gs4\") pod \"payload-processing-7c6c859784-gv4b6\" (UID: \"8f71f768-a487-484f-81cf-26dc8bbd9134\") " pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:11.349313 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.349289 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gs4\" (UniqueName: \"kubernetes.io/projected/8f71f768-a487-484f-81cf-26dc8bbd9134-kube-api-access-t9gs4\") pod \"payload-processing-7c6c859784-gv4b6\" (UID: \"8f71f768-a487-484f-81cf-26dc8bbd9134\") " pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:11.443218 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.443147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:11.445608 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.445586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdd96de1-c3ba-4e46-83aa-90073100347b-maas-api-tls\") pod \"maas-api-ff7765497-7kvzk\" (UID: \"bdd96de1-c3ba-4e46-83aa-90073100347b\") " pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:11.479154 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.479129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:11.609084 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.609061 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gv4b6"] Jun 03 19:45:11.611102 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:45:11.611076 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f71f768_a487_484f_81cf_26dc8bbd9134.slice/crio-412d0c7deaeec171b9e9d252785f080d0592eb3a38c47635efa7c7ecde47bed1 WatchSource:0}: Error finding container 412d0c7deaeec171b9e9d252785f080d0592eb3a38c47635efa7c7ecde47bed1: Status 404 returned error can't find the container with id 412d0c7deaeec171b9e9d252785f080d0592eb3a38c47635efa7c7ecde47bed1 Jun 03 19:45:11.654620 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.654599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:11.781973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:11.781948 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-ff7765497-7kvzk"] Jun 03 19:45:11.784350 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:45:11.784320 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd96de1_c3ba_4e46_83aa_90073100347b.slice/crio-540a79986eae9443e3a90a756b758592875e7f36479133617ffff88b5b616860 WatchSource:0}: Error finding container 540a79986eae9443e3a90a756b758592875e7f36479133617ffff88b5b616860: Status 404 returned error can't find the container with id 540a79986eae9443e3a90a756b758592875e7f36479133617ffff88b5b616860 Jun 03 19:45:12.170986 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:12.170950 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" event={"ID":"8f71f768-a487-484f-81cf-26dc8bbd9134","Type":"ContainerStarted","Data":"412d0c7deaeec171b9e9d252785f080d0592eb3a38c47635efa7c7ecde47bed1"} Jun 03 19:45:12.172216 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:12.172190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-ff7765497-7kvzk" event={"ID":"bdd96de1-c3ba-4e46-83aa-90073100347b","Type":"ContainerStarted","Data":"540a79986eae9443e3a90a756b758592875e7f36479133617ffff88b5b616860"} Jun 03 19:45:15.194092 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.194052 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-ff7765497-7kvzk" event={"ID":"bdd96de1-c3ba-4e46-83aa-90073100347b","Type":"ContainerStarted","Data":"bbd1fb8f91136737461be426df8868db219c3acbe28f6cf57a24072042b97209"} Jun 03 19:45:15.194554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.194172 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:15.195442 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.195420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" event={"ID":"8f71f768-a487-484f-81cf-26dc8bbd9134","Type":"ContainerStarted","Data":"a389cfc261c6ec96aeb2f56ad7b6b830bdfb952a1a95399d6fac33db3d32d50c"} Jun 03 19:45:15.195566 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.195543 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:15.211436 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.211390 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-ff7765497-7kvzk" podStartSLOduration=2.641125812 podStartE2EDuration="5.211377782s" totalImagesPullingTime="2.57025197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:45:15.209839165 +0000 UTC m=+868.895290580" watchObservedRunningTime="2026-06-03 19:45:15.211377782 +0000 UTC m=+868.896829196" Jun 03 19:45:15.225432 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:15.225393 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" podStartSLOduration=1.482225868 podStartE2EDuration="4.225381114s" totalImagesPullingTime="2.743155246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:45:15.224539399 +0000 UTC m=+868.909990814" watchObservedRunningTime="2026-06-03 19:45:15.225381114 +0000 UTC m=+868.910832528" Jun 03 19:45:21.204907 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:21.204876 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-ff7765497-7kvzk" Jun 03 19:45:26.201575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:26.201545 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gv4b6" Jun 03 19:45:46.781193 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:46.781162 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:45:46.783926 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:46.783903 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:45:46.790334 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:46.790310 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:45:46.792710 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:45:46.792694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:46:40.289192 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.289156 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj"] Jun 03 19:46:40.292563 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.292541 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.295178 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.295153 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 19:46:40.295308 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.295206 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:46:40.295308 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.295229 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:46:40.295883 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.295865 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ctq9\"" Jun 03 19:46:40.302716 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.302344 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj"] Jun 03 19:46:40.369300 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh6rd\" (UniqueName: \"kubernetes.io/projected/4501c75e-bc67-4601-9199-6b3b3d3901e2-kube-api-access-xh6rd\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.369460 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.369460 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.369460 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4501c75e-bc67-4601-9199-6b3b3d3901e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.369460 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369388 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.369632 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.369514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470361 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh6rd\" (UniqueName: \"kubernetes.io/projected/4501c75e-bc67-4601-9199-6b3b3d3901e2-kube-api-access-xh6rd\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4501c75e-bc67-4601-9199-6b3b3d3901e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470554 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470881 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470858 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470938 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.470997 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.470977 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.472731 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.472704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4501c75e-bc67-4601-9199-6b3b3d3901e2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.472969 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.472939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4501c75e-bc67-4601-9199-6b3b3d3901e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.477826 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.477808 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh6rd\" (UniqueName: \"kubernetes.io/projected/4501c75e-bc67-4601-9199-6b3b3d3901e2-kube-api-access-xh6rd\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dhhlj\" (UID: \"4501c75e-bc67-4601-9199-6b3b3d3901e2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.606064 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.606033 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:40.741612 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:40.741582 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj"] Jun 03 19:46:40.744363 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:46:40.744325 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4501c75e_bc67_4601_9199_6b3b3d3901e2.slice/crio-ec979d7057ed0bc6749b87786e710282482becfcbe71f36bebf7168747092888 WatchSource:0}: Error finding container ec979d7057ed0bc6749b87786e710282482becfcbe71f36bebf7168747092888: Status 404 returned error can't find the container with id ec979d7057ed0bc6749b87786e710282482becfcbe71f36bebf7168747092888 Jun 03 19:46:41.601519 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:41.601462 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" event={"ID":"4501c75e-bc67-4601-9199-6b3b3d3901e2","Type":"ContainerStarted","Data":"ec979d7057ed0bc6749b87786e710282482becfcbe71f36bebf7168747092888"} Jun 03 19:46:44.619350 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:44.619308 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" event={"ID":"4501c75e-bc67-4601-9199-6b3b3d3901e2","Type":"ContainerStarted","Data":"33816fe6880f03185e8aaa2ae40635dab5a6d5d7f1469310d257dce360ccac05"} Jun 03 19:46:45.625154 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:45.625119 2557 generic.go:356] "Generic (PLEG): container finished" podID="4501c75e-bc67-4601-9199-6b3b3d3901e2" containerID="33816fe6880f03185e8aaa2ae40635dab5a6d5d7f1469310d257dce360ccac05" exitCode=0 Jun 03 19:46:45.625545 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:45.625173 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" event={"ID":"4501c75e-bc67-4601-9199-6b3b3d3901e2","Type":"ContainerDied","Data":"33816fe6880f03185e8aaa2ae40635dab5a6d5d7f1469310d257dce360ccac05"} Jun 03 19:46:47.636492 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.636455 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" event={"ID":"4501c75e-bc67-4601-9199-6b3b3d3901e2","Type":"ContainerStarted","Data":"aa0e79a0e85d71f7ec23f3e2996f3983d8e0fd7ab28224c79f7deed2f1cbea77"} Jun 03 19:46:47.656916 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.656870 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" podStartSLOduration=2.146052016 podStartE2EDuration="7.656854049s" totalImagesPullingTime="4.158827138s" totalInitContainerRuntime="1.351974895s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:47.65469226 +0000 UTC m=+961.340143673" watchObservedRunningTime="2026-06-03 19:46:47.656854049 +0000 UTC m=+961.342305464" Jun 03 19:46:47.903451 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.903368 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm"] Jun 03 19:46:47.906177 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.906155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:47.908378 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.908357 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 19:46:47.917080 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:47.917056 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm"] Jun 03 19:46:48.040639 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.040600 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.040921 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.040897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.041054 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.040931 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6mjw\" (UniqueName: \"kubernetes.io/projected/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kube-api-access-k6mjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.041054 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.041025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.041138 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.041078 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.041138 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.041127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142208 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142208 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142211 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6mjw\" (UniqueName: \"kubernetes.io/projected/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kube-api-access-k6mjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142427 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142427 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142675 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142653 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142930 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142930 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.142930 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.142879 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.143139 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.143075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.144416 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.144393 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.145462 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.145432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.150488 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.150458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6mjw\" (UniqueName: \"kubernetes.io/projected/453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9-kube-api-access-k6mjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm\" (UID: \"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.216867 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.216792 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:48.349041 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.349018 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm"] Jun 03 19:46:48.351193 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:46:48.351168 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453a3abd_5bdd_4e92_86ee_4bfc8c4f60f9.slice/crio-ca5531062d1e3bdbc32ddefe0ba6a4d9acee1c2ffe155da05b89deabd10bbcb0 WatchSource:0}: Error finding container ca5531062d1e3bdbc32ddefe0ba6a4d9acee1c2ffe155da05b89deabd10bbcb0: Status 404 returned error can't find the container with id ca5531062d1e3bdbc32ddefe0ba6a4d9acee1c2ffe155da05b89deabd10bbcb0 Jun 03 19:46:48.643973 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.643930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" event={"ID":"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9","Type":"ContainerStarted","Data":"2ba95526614eb30d9cd6dbbbb8148aefd7060747384508b48758cedd9196ecbe"} Jun 03 19:46:48.644438 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:48.643999 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" event={"ID":"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9","Type":"ContainerStarted","Data":"ca5531062d1e3bdbc32ddefe0ba6a4d9acee1c2ffe155da05b89deabd10bbcb0"} Jun 03 19:46:49.650889 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:49.650855 2557 generic.go:356] "Generic (PLEG): container finished" podID="453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9" containerID="2ba95526614eb30d9cd6dbbbb8148aefd7060747384508b48758cedd9196ecbe" exitCode=0 Jun 03 19:46:49.651194 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:49.650930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" event={"ID":"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9","Type":"ContainerDied","Data":"2ba95526614eb30d9cd6dbbbb8148aefd7060747384508b48758cedd9196ecbe"} Jun 03 19:46:50.607125 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.607063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:50.607294 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.607158 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:50.619422 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.619401 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:50.657642 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.657611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" event={"ID":"453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9","Type":"ContainerStarted","Data":"896adfbcc7eb32983bb8703127d8f3263b5877021cd6a521ac87d4d430640bb6"} Jun 03 19:46:50.668640 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.668611 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dhhlj" Jun 03 19:46:50.675542 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:50.675468 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" podStartSLOduration=2.135465067 podStartE2EDuration="3.675454058s" totalImagesPullingTime="321.651446ms" totalInitContainerRuntime="1.218337545s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:50.673119729 +0000 UTC m=+964.358571169" watchObservedRunningTime="2026-06-03 19:46:50.675454058 +0000 UTC m=+964.360905472" Jun 03 19:46:58.217421 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:58.217338 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:58.217421 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:58.217414 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:58.229361 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:58.229336 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:46:58.707614 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:46:58.707576 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm" Jun 03 19:50:00.029818 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.029731 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:50:00.030378 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.029963 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-584786f555-5px22" podUID="c4339a07-625e-4922-af4b-d47a2840252d" containerName="manager" containerID="cri-o://24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54" gracePeriod=30 Jun 03 19:50:00.284626 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.284564 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:50:00.365542 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.365510 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m49hj\" (UniqueName: \"kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj\") pod \"c4339a07-625e-4922-af4b-d47a2840252d\" (UID: \"c4339a07-625e-4922-af4b-d47a2840252d\") " Jun 03 19:50:00.367684 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.367654 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj" (OuterVolumeSpecName: "kube-api-access-m49hj") pod "c4339a07-625e-4922-af4b-d47a2840252d" (UID: "c4339a07-625e-4922-af4b-d47a2840252d"). InnerVolumeSpecName "kube-api-access-m49hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:50:00.466575 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.466541 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m49hj\" (UniqueName: \"kubernetes.io/projected/c4339a07-625e-4922-af4b-d47a2840252d-kube-api-access-m49hj\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\"" Jun 03 19:50:00.586246 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.586164 2557 generic.go:356] "Generic (PLEG): container finished" podID="c4339a07-625e-4922-af4b-d47a2840252d" containerID="24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54" exitCode=0 Jun 03 19:50:00.586246 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.586211 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-5px22" Jun 03 19:50:00.586422 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.586255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-5px22" event={"ID":"c4339a07-625e-4922-af4b-d47a2840252d","Type":"ContainerDied","Data":"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54"} Jun 03 19:50:00.586422 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.586306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-5px22" event={"ID":"c4339a07-625e-4922-af4b-d47a2840252d","Type":"ContainerDied","Data":"6e9f601a0c5690bd3f7f872febf6e2a6c51c7fadb3ed45e049e54dd2084a2d92"} Jun 03 19:50:00.586422 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.586328 2557 scope.go:117] "RemoveContainer" containerID="24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54" Jun 03 19:50:00.596354 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.596336 2557 scope.go:117] "RemoveContainer" containerID="24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54" Jun 03 19:50:00.596665 ip-10-0-136-129 kubenswrapper[2557]: E0603 19:50:00.596634 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54\": container with ID starting with 24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54 not found: ID does not exist" containerID="24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54" Jun 03 19:50:00.596749 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.596669 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54"} err="failed to get container status \"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54\": rpc error: code = NotFound desc = could not find container \"24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54\": container with ID starting with 24c2c5c4692df0cad35818ee1e8c2122282a3a0dc7f56a280c5c5eb415fccb54 not found: ID does not exist" Jun 03 19:50:00.606942 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.606919 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:50:00.612218 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.612196 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-584786f555-5px22"] Jun 03 19:50:00.782485 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:00.782442 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4339a07-625e-4922-af4b-d47a2840252d" path="/var/lib/kubelet/pods/c4339a07-625e-4922-af4b-d47a2840252d/volumes" Jun 03 19:50:01.322609 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.322571 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-584786f555-rk8pw"] Jun 03 19:50:01.323170 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.323150 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4339a07-625e-4922-af4b-d47a2840252d" containerName="manager" Jun 03 19:50:01.323248 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.323174 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4339a07-625e-4922-af4b-d47a2840252d" containerName="manager" Jun 03 19:50:01.323302 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.323280 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4339a07-625e-4922-af4b-d47a2840252d" containerName="manager" Jun 03 19:50:01.327552 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.327509 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:01.330211 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.330193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bcblb\"" Jun 03 19:50:01.330328 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.330193 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:50:01.335672 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.335644 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584786f555-rk8pw"] Jun 03 19:50:01.475670 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.475623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg9rj\" (UniqueName: \"kubernetes.io/projected/8d7e0099-0da9-42a0-be5c-b764d457db5e-kube-api-access-rg9rj\") pod \"maas-controller-584786f555-rk8pw\" (UID: \"8d7e0099-0da9-42a0-be5c-b764d457db5e\") " pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:01.576168 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.576070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg9rj\" (UniqueName: \"kubernetes.io/projected/8d7e0099-0da9-42a0-be5c-b764d457db5e-kube-api-access-rg9rj\") pod \"maas-controller-584786f555-rk8pw\" (UID: \"8d7e0099-0da9-42a0-be5c-b764d457db5e\") " pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:01.584361 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.584327 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg9rj\" (UniqueName: \"kubernetes.io/projected/8d7e0099-0da9-42a0-be5c-b764d457db5e-kube-api-access-rg9rj\") pod \"maas-controller-584786f555-rk8pw\" (UID: \"8d7e0099-0da9-42a0-be5c-b764d457db5e\") " pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:01.638092 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.638060 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:01.777390 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.777363 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584786f555-rk8pw"] Jun 03 19:50:01.779121 ip-10-0-136-129 kubenswrapper[2557]: W0603 19:50:01.779098 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7e0099_0da9_42a0_be5c_b764d457db5e.slice/crio-4e1f30a5bee8eaf59c990ad2a35894035d2c50a2d2f15e444596b34c11dd99f9 WatchSource:0}: Error finding container 4e1f30a5bee8eaf59c990ad2a35894035d2c50a2d2f15e444596b34c11dd99f9: Status 404 returned error can't find the container with id 4e1f30a5bee8eaf59c990ad2a35894035d2c50a2d2f15e444596b34c11dd99f9 Jun 03 19:50:01.780412 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:01.780395 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:50:02.599105 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:02.599071 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-rk8pw" event={"ID":"8d7e0099-0da9-42a0-be5c-b764d457db5e","Type":"ContainerStarted","Data":"55f029d2b461f29a288b78648d59702b3a220b48fc0d447d43ea4fc44781137c"} Jun 03 19:50:02.599503 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:02.599150 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584786f555-rk8pw" event={"ID":"8d7e0099-0da9-42a0-be5c-b764d457db5e","Type":"ContainerStarted","Data":"4e1f30a5bee8eaf59c990ad2a35894035d2c50a2d2f15e444596b34c11dd99f9"} Jun 03 19:50:02.599503 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:02.599216 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:02.616004 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:02.615958 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-584786f555-rk8pw" podStartSLOduration=1.0618048390000001 podStartE2EDuration="1.615939454s" totalImagesPullingTime="554.134615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:02.613300204 +0000 UTC m=+1156.298751643" watchObservedRunningTime="2026-06-03 19:50:02.615939454 +0000 UTC m=+1156.301390871" Jun 03 19:50:13.609402 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:13.609362 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-584786f555-rk8pw" Jun 03 19:50:46.813559 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:46.813526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:50:46.818050 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:46.818026 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:50:46.823251 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:46.823230 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:50:46.827897 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:50:46.827880 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:55:46.843247 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:55:46.843217 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:55:46.852003 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:55:46.851977 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 19:55:46.852464 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:55:46.852446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 19:55:46.861324 ip-10-0-136-129 kubenswrapper[2557]: I0603 19:55:46.861304 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:00:18.216179 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:18.216143 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 20:00:18.216840 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:18.216348 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" podUID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" containerName="manager" containerID="cri-o://b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44" gracePeriod=10 Jun 03 20:00:19.185673 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.185645 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 20:00:19.268742 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.268666 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume\") pod \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " Jun 03 20:00:19.269087 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.268742 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh\") pod \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\" (UID: \"dd66d22d-41e3-4ee8-9516-50dbd12d2af0\") " Jun 03 20:00:19.269087 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.269080 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dd66d22d-41e3-4ee8-9516-50dbd12d2af0" (UID: "dd66d22d-41e3-4ee8-9516-50dbd12d2af0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:00:19.270950 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.270927 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh" (OuterVolumeSpecName: "kube-api-access-5cchh") pod "dd66d22d-41e3-4ee8-9516-50dbd12d2af0" (UID: "dd66d22d-41e3-4ee8-9516-50dbd12d2af0"). InnerVolumeSpecName "kube-api-access-5cchh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:00:19.370306 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.370269 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-extensions-socket-volume\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\"" Jun 03 20:00:19.370306 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.370299 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/dd66d22d-41e3-4ee8-9516-50dbd12d2af0-kube-api-access-5cchh\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\"" Jun 03 20:00:19.688503 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.688442 2557 generic.go:356] "Generic (PLEG): container finished" podID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" containerID="b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44" exitCode=0 Jun 03 20:00:19.688702 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.688518 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" Jun 03 20:00:19.688702 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.688524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" event={"ID":"dd66d22d-41e3-4ee8-9516-50dbd12d2af0","Type":"ContainerDied","Data":"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44"} Jun 03 20:00:19.688702 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.688579 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb" event={"ID":"dd66d22d-41e3-4ee8-9516-50dbd12d2af0","Type":"ContainerDied","Data":"5c09782410238854832af2a348b80a20f7ae07f910d1e0732cd8bd651e06c9a2"} Jun 03 20:00:19.688702 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.688602 2557 scope.go:117] "RemoveContainer" containerID="b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44" Jun 03 20:00:19.698135 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.698116 2557 scope.go:117] "RemoveContainer" containerID="b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44" Jun 03 20:00:19.698368 ip-10-0-136-129 kubenswrapper[2557]: E0603 20:00:19.698346 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44\": container with ID starting with b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44 not found: ID does not exist" containerID="b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44" Jun 03 20:00:19.698460 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.698372 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44"} err="failed to get container status \"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44\": rpc error: code = NotFound desc = could not find container \"b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44\": container with ID starting with b2ffdb7816eaafc66cde99881ab189dff8b7d4553976898e99e475ba3d626f44 not found: ID does not exist" Jun 03 20:00:19.710161 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.710140 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 20:00:19.714302 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:19.714279 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4lqsb"] Jun 03 20:00:20.783135 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:20.783103 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" path="/var/lib/kubelet/pods/dd66d22d-41e3-4ee8-9516-50dbd12d2af0/volumes" Jun 03 20:00:46.875183 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:46.875155 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:00:46.883889 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:46.883869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:00:46.884167 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:46.884151 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:00:46.892117 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:00:46.892100 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:05:46.908441 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:05:46.908411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:05:46.914840 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:05:46.914816 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:05:46.917827 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:05:46.917804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:05:46.923593 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:05:46.923577 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:10:46.938361 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:10:46.938330 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:10:46.945212 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:10:46.945191 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:10:46.947723 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:10:46.947702 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:10:46.953619 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:10:46.953602 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:11:29.633562 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:29.633504 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbff5bcdc-6qd6c_3268f59c-2e0b-446b-b1e1-77fbabd111e5/nginx/0.log" Jun 03 20:11:29.848746 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:29.848717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ldwvc_221381f3-c399-44fe-8209-9e050f8d44a9/manager/0.log" Jun 03 20:11:29.960990 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:29.960911 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lmg54_ec30bd03-eb9b-4b3f-95d5-460cc99e5a71/manager/0.log" Jun 03 20:11:30.070303 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.070274 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-ff7765497-7kvzk_bdd96de1-c3ba-4e46-83aa-90073100347b/maas-api/0.log" Jun 03 20:11:30.291844 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.291743 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-584786f555-rk8pw_8d7e0099-0da9-42a0-be5c-b764d457db5e/manager/0.log" Jun 03 20:11:30.404763 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.404736 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-886h7_32e6b80a-8aca-4c7d-83bd-349f9452cfd6/server/0.log" Jun 03 20:11:30.518930 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.518893 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wl8fb_60196090-f651-41e4-89c8-6de2579144c9/manager/0.log" Jun 03 20:11:30.754607 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.754581 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-8xjq2_12ef381d-799d-486a-b65f-4fadc1537f69/copy-manifests/0.log" Jun 03 20:11:30.767186 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:30.767150 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-8xjq2_12ef381d-799d-486a-b65f-4fadc1537f69/manager/0.log" Jun 03 20:11:32.318404 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:32.318357 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-64pqg_3cc43ca9-16ba-4995-839c-655355ece21f/manager/0.log" Jun 03 20:11:32.426675 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:32.426649 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c79s7_5735f6f5-1f45-4e50-8b90-91d37125be6d/manager/0.log" Jun 03 20:11:33.434138 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:33.434108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cnpdh_bc815c63-519a-4fa3-8e65-e869ac699eac/discovery/0.log" Jun 03 20:11:33.538653 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:33.538598 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-grzw6_93af5aec-a2aa-4cdc-ad1f-720942426a42/kube-auth-proxy/0.log" Jun 03 20:11:33.872804 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:33.872774 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gv4b6_8f71f768-a487-484f-81cf-26dc8bbd9134/payload-processing/0.log" Jun 03 20:11:34.412105 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:34.412077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dhhlj_4501c75e-bc67-4601-9199-6b3b3d3901e2/storage-initializer/0.log" Jun 03 20:11:34.418842 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:34.418798 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dhhlj_4501c75e-bc67-4601-9199-6b3b3d3901e2/main/0.log" Jun 03 20:11:34.534281 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:34.534237 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm_453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9/storage-initializer/0.log" Jun 03 20:11:34.541500 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:34.541462 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mmlcm_453a3abd-5bdd-4e92-86ee-4bfc8c4f60f9/main/0.log" Jun 03 20:11:39.041175 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.041136 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrmj9/must-gather-zjbb5"] Jun 03 20:11:39.041555 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.041542 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" containerName="manager" Jun 03 20:11:39.041555 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.041555 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" containerName="manager" Jun 03 20:11:39.041648 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.041638 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd66d22d-41e3-4ee8-9516-50dbd12d2af0" containerName="manager" Jun 03 20:11:39.043852 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.043832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.046057 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.046036 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jrmj9\"/\"default-dockercfg-8mhg6\"" Jun 03 20:11:39.046345 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.046328 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"openshift-service-ca.crt\"" Jun 03 20:11:39.046817 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.046802 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"kube-root-ca.crt\"" Jun 03 20:11:39.061028 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.061002 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/must-gather-zjbb5"] Jun 03 20:11:39.161750 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.161702 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/45da1010-ffb7-4647-b9a2-49db509d2cbc-must-gather-output\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.161928 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.161780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdcrk\" (UniqueName: \"kubernetes.io/projected/45da1010-ffb7-4647-b9a2-49db509d2cbc-kube-api-access-mdcrk\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.262322 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.262288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/45da1010-ffb7-4647-b9a2-49db509d2cbc-must-gather-output\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.262515 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.262330 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdcrk\" (UniqueName: \"kubernetes.io/projected/45da1010-ffb7-4647-b9a2-49db509d2cbc-kube-api-access-mdcrk\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.262688 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.262670 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/45da1010-ffb7-4647-b9a2-49db509d2cbc-must-gather-output\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.269977 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.269954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdcrk\" (UniqueName: \"kubernetes.io/projected/45da1010-ffb7-4647-b9a2-49db509d2cbc-kube-api-access-mdcrk\") pod \"must-gather-zjbb5\" (UID: \"45da1010-ffb7-4647-b9a2-49db509d2cbc\") " pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.352924 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.352895 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" Jun 03 20:11:39.482285 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.482262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/must-gather-zjbb5"] Jun 03 20:11:39.484194 ip-10-0-136-129 kubenswrapper[2557]: W0603 20:11:39.484168 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45da1010_ffb7_4647_b9a2_49db509d2cbc.slice/crio-6f582d7406f3afd574d427bf7ee3d5754a5177321e40ed6fb88617829273fbd5 WatchSource:0}: Error finding container 6f582d7406f3afd574d427bf7ee3d5754a5177321e40ed6fb88617829273fbd5: Status 404 returned error can't find the container with id 6f582d7406f3afd574d427bf7ee3d5754a5177321e40ed6fb88617829273fbd5 Jun 03 20:11:39.485951 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:39.485936 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:11:40.008316 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:40.008271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" event={"ID":"45da1010-ffb7-4647-b9a2-49db509d2cbc","Type":"ContainerStarted","Data":"6f582d7406f3afd574d427bf7ee3d5754a5177321e40ed6fb88617829273fbd5"} Jun 03 20:11:41.015429 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:41.015386 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" event={"ID":"45da1010-ffb7-4647-b9a2-49db509d2cbc","Type":"ContainerStarted","Data":"3ab9f3f21529f0a7929f6ca0692aeb68f013ac32ed6889bc979eaad452ae095b"} Jun 03 20:11:41.015862 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:41.015452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" event={"ID":"45da1010-ffb7-4647-b9a2-49db509d2cbc","Type":"ContainerStarted","Data":"2265fb6c44c2ecb3b2ca62b5ecd9e8f60e0aaca042c20a4dd190a6b74b7e9b79"} Jun 03 20:11:41.031624 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:41.031563 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrmj9/must-gather-zjbb5" podStartSLOduration=1.3914864009999999 podStartE2EDuration="2.03154223s" totalImagesPullingTime="640.055829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:11:41.028668373 +0000 UTC m=+2454.714119788" watchObservedRunningTime="2026-06-03 20:11:41.03154223 +0000 UTC m=+2454.716993644" Jun 03 20:11:41.984936 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:41.984907 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-74c2p_867b41e5-9cad-41fb-825c-c25cba40d388/global-pull-secret-syncer/0.log" Jun 03 20:11:42.120548 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:42.120497 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s2ljb_cf64506b-7674-44c0-a5e1-2ac34f647f2b/konnectivity-agent/0.log" Jun 03 20:11:42.182960 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:42.182933 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-129.ec2.internal_d2ddd283c46ec457f2982371f0fd3809/haproxy/0.log" Jun 03 20:11:45.571611 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:45.571574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-fwz4p_47b380cb-6b6e-434d-8b48-062b3e6e2926/sail-operator/0.log" Jun 03 20:11:47.003313 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:47.003243 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-64pqg_3cc43ca9-16ba-4995-839c-655355ece21f/manager/0.log" Jun 03 20:11:47.039238 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:47.039209 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c79s7_5735f6f5-1f45-4e50-8b90-91d37125be6d/manager/0.log" Jun 03 20:11:49.416733 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.416678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq49h_ddda9dec-a0e0-4c4c-b024-1925692a4e49/node-exporter/0.log" Jun 03 20:11:49.440046 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.440010 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq49h_ddda9dec-a0e0-4c4c-b024-1925692a4e49/kube-rbac-proxy/0.log" Jun 03 20:11:49.459056 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.459016 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq49h_ddda9dec-a0e0-4c4c-b024-1925692a4e49/init-textfile/0.log" Jun 03 20:11:49.487741 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.487712 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbvq9_ac61240c-3d94-4c43-98e4-feeb9971662d/kube-rbac-proxy-main/0.log" Jun 03 20:11:49.510009 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.509949 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbvq9_ac61240c-3d94-4c43-98e4-feeb9971662d/kube-rbac-proxy-self/0.log" Jun 03 20:11:49.538004 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:49.537962 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbvq9_ac61240c-3d94-4c43-98e4-feeb9971662d/openshift-state-metrics/0.log" Jun 03 20:11:51.702116 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:51.702085 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-jsdhb_b9b3c532-9845-4fd8-9507-d5f3b05ddc49/networking-console-plugin/0.log" Jun 03 20:11:52.352125 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:52.352073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/1.log" Jun 03 20:11:52.360696 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:52.360659 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-xw4mh_8407ed06-6165-492d-9c93-8ae0cd2c82ad/console-operator/2.log" Jun 03 20:11:54.532316 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.532283 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56"] Jun 03 20:11:54.537799 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.537773 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.546015 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.545983 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56"] Jun 03 20:11:54.626175 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.626124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd968\" (UniqueName: \"kubernetes.io/projected/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-kube-api-access-pd968\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.626503 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.626460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-sys\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.626656 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.626643 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-proc\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.626936 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.626917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-lib-modules\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.627084 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.627065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-podres\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.728453 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.728417 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd968\" (UniqueName: \"kubernetes.io/projected/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-kube-api-access-pd968\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.728752 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.728731 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-sys\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.728869 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.728855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-proc\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729065 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-lib-modules\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729169 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-podres\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729406 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-podres\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729587 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-sys\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729674 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729581 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-proc\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.729674 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.729627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-lib-modules\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.738990 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.738963 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd968\" (UniqueName: \"kubernetes.io/projected/50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427-kube-api-access-pd968\") pod \"perf-node-gather-daemonset-2mr56\" (UID: \"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.851741 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.851711 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:54.904396 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.904291 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6bj5l_7d8df76a-fe60-4a28-9aee-847de7169b3f/dns/0.log" Jun 03 20:11:54.926629 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.926605 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6bj5l_7d8df76a-fe60-4a28-9aee-847de7169b3f/kube-rbac-proxy/0.log" Jun 03 20:11:54.996591 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:54.990052 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cnqgg_2aad1e08-59f9-4f3c-ba3f-406de123624c/dns-node-resolver/0.log" Jun 03 20:11:55.003812 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:55.003782 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56"] Jun 03 20:11:55.012808 ip-10-0-136-129 kubenswrapper[2557]: W0603 20:11:55.012782 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50b66f82_6fa1_4ffd_bd7d_c66e6bbb2427.slice/crio-e85d9461cb05392e55d477794514ba1d78f21ee3998775afc7bada7f290d9f45 WatchSource:0}: Error finding container e85d9461cb05392e55d477794514ba1d78f21ee3998775afc7bada7f290d9f45: Status 404 returned error can't find the container with id e85d9461cb05392e55d477794514ba1d78f21ee3998775afc7bada7f290d9f45 Jun 03 20:11:55.115987 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:55.115581 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" event={"ID":"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427","Type":"ContainerStarted","Data":"e85d9461cb05392e55d477794514ba1d78f21ee3998775afc7bada7f290d9f45"} Jun 03 20:11:55.550057 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:55.549977 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f65648f66-pjx8c_06784d9f-eb4d-476b-871c-9531654eb571/registry/0.log" Jun 03 20:11:55.611874 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:55.611837 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vg85g_a9a78be6-3c36-4274-ba07-08c18b84e659/node-ca/0.log" Jun 03 20:11:56.125002 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.124945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" event={"ID":"50b66f82-6fa1-4ffd-bd7d-c66e6bbb2427","Type":"ContainerStarted","Data":"2bb0be51842b3a704cc9105fc92b347557178b5fe987c3263640a25917afc3c7"} Jun 03 20:11:56.125221 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.125123 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:11:56.139189 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.139122 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" podStartSLOduration=2.139101266 podStartE2EDuration="2.139101266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:11:56.138741926 +0000 UTC m=+2469.824193378" watchObservedRunningTime="2026-06-03 20:11:56.139101266 +0000 UTC m=+2469.824552683" Jun 03 20:11:56.633406 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.633375 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cnpdh_bc815c63-519a-4fa3-8e65-e869ac699eac/discovery/0.log" Jun 03 20:11:56.653586 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.653563 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-grzw6_93af5aec-a2aa-4cdc-ad1f-720942426a42/kube-auth-proxy/0.log" Jun 03 20:11:56.807679 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:56.807646 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gv4b6_8f71f768-a487-484f-81cf-26dc8bbd9134/payload-processing/0.log" Jun 03 20:11:57.419925 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:57.419898 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jrv6f_3ade2059-50ad-4972-960c-a5f959f82b1d/serve-healthcheck-canary/0.log" Jun 03 20:11:58.069754 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:58.069728 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gxgf_1bc1a65d-2c1d-4646-acbe-748dbd907a94/kube-rbac-proxy/0.log" Jun 03 20:11:58.089377 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:58.089346 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gxgf_1bc1a65d-2c1d-4646-acbe-748dbd907a94/exporter/0.log" Jun 03 20:11:58.109148 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:11:58.109124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gxgf_1bc1a65d-2c1d-4646-acbe-748dbd907a94/extractor/0.log" Jun 03 20:12:00.514952 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.514914 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbff5bcdc-6qd6c_3268f59c-2e0b-446b-b1e1-77fbabd111e5/nginx/0.log" Jun 03 20:12:00.559229 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.559196 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ldwvc_221381f3-c399-44fe-8209-9e050f8d44a9/manager/0.log" Jun 03 20:12:00.654244 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.654210 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lmg54_ec30bd03-eb9b-4b3f-95d5-460cc99e5a71/manager/0.log" Jun 03 20:12:00.690396 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.690358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-ff7765497-7kvzk_bdd96de1-c3ba-4e46-83aa-90073100347b/maas-api/0.log" Jun 03 20:12:00.797074 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.796988 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-584786f555-rk8pw_8d7e0099-0da9-42a0-be5c-b764d457db5e/manager/0.log" Jun 03 20:12:00.815361 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.815331 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-886h7_32e6b80a-8aca-4c7d-83bd-349f9452cfd6/server/0.log" Jun 03 20:12:00.868648 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:00.868612 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wl8fb_60196090-f651-41e4-89c8-6de2579144c9/manager/0.log" Jun 03 20:12:01.044407 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:01.044372 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-8xjq2_12ef381d-799d-486a-b65f-4fadc1537f69/manager/0.log" Jun 03 20:12:01.059572 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:01.059495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-8xjq2_12ef381d-799d-486a-b65f-4fadc1537f69/copy-manifests/0.log" Jun 03 20:12:02.140763 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:02.140736 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-2mr56" Jun 03 20:12:02.642125 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:02.642068 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kqlt2_1a7d0850-4fbc-4dc0-bb8d-a483d41c3e05/openshift-lws-operator/0.log" Jun 03 20:12:07.302881 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:07.302848 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cnpdh_bc815c63-519a-4fa3-8e65-e869ac699eac/discovery/0.log" Jun 03 20:12:07.311706 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:07.311687 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-grzw6_93af5aec-a2aa-4cdc-ad1f-720942426a42/kube-auth-proxy/0.log" Jun 03 20:12:07.444606 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:07.444551 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gv4b6_8f71f768-a487-484f-81cf-26dc8bbd9134/payload-processing/0.log" Jun 03 20:12:08.056677 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:08.056648 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mnzwv_2236ac9c-1e8c-4052-9e91-80c349bebabc/migrator/0.log" Jun 03 20:12:08.075773 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:08.075747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mnzwv_2236ac9c-1e8c-4052-9e91-80c349bebabc/graceful-termination/0.log" Jun 03 20:12:08.704395 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:08.704362 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cnpdh_bc815c63-519a-4fa3-8e65-e869ac699eac/discovery/0.log" Jun 03 20:12:08.715810 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:08.715783 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-grzw6_93af5aec-a2aa-4cdc-ad1f-720942426a42/kube-auth-proxy/0.log" Jun 03 20:12:08.851094 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:08.851056 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gv4b6_8f71f768-a487-484f-81cf-26dc8bbd9134/payload-processing/0.log" Jun 03 20:12:09.973014 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:09.972985 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/kube-multus-additional-cni-plugins/0.log" Jun 03 20:12:09.992317 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:09.992288 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/egress-router-binary-copy/0.log" Jun 03 20:12:10.012084 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.012050 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/cni-plugins/0.log" Jun 03 20:12:10.032538 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.032504 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/bond-cni-plugin/0.log" Jun 03 20:12:10.056216 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.056191 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/routeoverride-cni/0.log" Jun 03 20:12:10.076095 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.076069 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/whereabouts-cni-bincopy/0.log" Jun 03 20:12:10.095836 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.095806 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v6wtx_4e2e1f10-313e-4772-9fda-51e7ab47e1ba/whereabouts-cni/0.log" Jun 03 20:12:10.291595 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.291520 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ghh4s_c08f4a7c-1e55-4b76-bd80-ec3f1179b204/kube-multus/0.log" Jun 03 20:12:10.388840 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.388808 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z5vhs_1dbf39bc-d077-40f8-83c9-42e0b08dc9fd/network-metrics-daemon/0.log" Jun 03 20:12:10.407529 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.407460 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z5vhs_1dbf39bc-d077-40f8-83c9-42e0b08dc9fd/kube-rbac-proxy/0.log" Jun 03 20:12:10.517570 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.517541 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cnpdh_bc815c63-519a-4fa3-8e65-e869ac699eac/discovery/0.log" Jun 03 20:12:10.530113 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.528696 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-grzw6_93af5aec-a2aa-4cdc-ad1f-720942426a42/kube-auth-proxy/0.log" Jun 03 20:12:10.656931 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:10.656901 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gv4b6_8f71f768-a487-484f-81cf-26dc8bbd9134/payload-processing/0.log" Jun 03 20:12:11.581764 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.581734 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-controller/0.log" Jun 03 20:12:11.598813 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.598788 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/0.log" Jun 03 20:12:11.598956 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.598818 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovn-acl-logging/1.log" Jun 03 20:12:11.621079 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.621054 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/kube-rbac-proxy-node/0.log" Jun 03 20:12:11.643129 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.643105 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 20:12:11.660519 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.660445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/northd/0.log" Jun 03 20:12:11.680073 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.680047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/nbdb/0.log" Jun 03 20:12:11.701078 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.701053 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/sbdb/0.log" Jun 03 20:12:11.746451 ip-10-0-136-129 kubenswrapper[2557]: I0603 20:12:11.746421 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47tl_a0bb0f0e-7c9b-4736-a956-cbcbfeae4d11/ovnkube-controller/0.log"